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THE G/GI/N QUEUE IN THE HALFIN WHITT REGIME 1 

By Josh Reed 

New York University 

In this paper, we study the G/GI/N queue in the Halfin-Whitt 
regime. Our first result is to obtain a deterministic fluid limit for 
the properly centered and scaled number of customers in the sys- 
tem which may be used to provide a first-order approximation to the 
queue length process. Our second result is to obtain a second-order 
stochastic approximation to the number of customers in the system 
in the Halfin-Whitt regime. This is accomplished by first centering 
the queue length process by its deterministic fluid limit and then 
normalizing by an appropriate factor. We then proceed to obtain an 
alternative but equivalent characterization of our limiting approxima- 
tion which involves the renewal function associated with the service 
time distribution. This alternative characterization reduces to the 
diffusion process obtained by Halfm and Whitt [Oper. Res. 29 (1981) 
567-588] in the case of exponentially distributed service times. 

1. Introduction. In this paper, we study the G/GI/N queue in the 
Halfin-Whitt regime. This problem has received considerable attention in 
the literature recently, however, to this date it has remained an open prob- 
lem to extend the pioneering work of Halfm and Whitt [6] on the GI/M/N 
queue to the more general Gj GI/N queue. In this paper and its sequel [18], 
we resolve this open problem by providing both fluid and diffusion limit 
results for the queue length process of the G/GI/N queue in the Halfin- 
Whitt regime. In addition to providing these results, we also hope that the 
general methodology which is employed here, labeled the "Infinite Server 
Queue Systems Equations" approach (see below), will be helpful in future 
applications. 
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Loosely speaking, the Halfin-Whitt regime is achieved by considering a 
sequence of many server queues indexed by the number of servers queues in- 
dexed by the number of servers N where the arrival rate to the system grows 
large but the service time distribution remains fixed. Specifically, denoting 
by A^ the arrival rate to the iVth system, we assume that 

A^ — > oo asiV^oo. 

In order for the sequence of systems to remain stable, this then requires that 
the number of servers be large enough to handle the growing arrival rate. In 
particular, assuming without loss of generality that the mean service time 
is equal to one and denoting by p N = X N /N the traffic intensity to the iVth 
system, in the Halfin-Whitt regime we assume that 

VN(1 -p N )^P as N -c oo, 

where — oo < (3 < oo. Thus, in the Halfin-Whitt regime we assume that the 
traffic intensity of the system remains close to 1 while the number of servers 
grows without bound. Note also by the results of Kiefer and Wolfowitz [13], 
that, if (3 > 0, then, for large enough N, the sequence of systems will be stable 
in the pre-limit, while if j3 < 0, they will not. The case [3 = is indeterminate. 

Halfin and Whitt showed in their seminal paper [8] that in the regime 
described above, the properly centered and scaled queue length process will 
converge to a limiting diffusion. Unfortunately, they were not able to ex- 
tend their results beyond the assumption of exponential service time dis- 
tributions. This is mainly due to the fact that the infinitesimal generator 
approach to their proof breaks down when the service times are no longer 
exponentially distributed. This has naturally led to much speculation in the 
literature as to how to approach the situation of general service time dis- 
tributions and specifically in such situations what the limiting process of 
the properly centered and scaled queue length process must be. In an effort 
to answer this question, several authors have recently obtained convergence 
results for carefully selected classes of service time distributions which are 
particularly well suited to analysis. Puhalskii and Reiman [17] have demon- 
strated convergence of the G/PH /N queue length process in the Halfin and 
Whitt regime, where PH stands for phase type service time distributions. 
Their approach is to consider a multi-dimensional Markovian process where 
each dimension corresponds to a different phase of the service time distribu- 
tion. Jelenkovic, Mandelbaum and Momcilovic [10] have shown convergence 
of the steady state distribution of the GI/D/N queue, where D stands for 
deterministic service times. Their proof involves focusing on a single server 
in the system and studying its queue length behavior as it evolves over 
time. Whitt in [21] has shown process level convergence of the G/H2/N/M 
queue, where stands for a mixture of an exponential random variable and 
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a point mass at zero. In [16] , Mandelbaum and Momcilovic study the virtual 
waiting time process of Gf GI /N in the Halfin-Whitt regime assuming that 
the service time distribution possess finite support. Their approach relies 
on a combination of combinatorial and probabilistic arguments. Gamarnik 
and Momcilovic [5] analyze the GI/GI/N queue assuming that the service 
time distribution is lattice valued with finite support. They analyze the sta- 
tionary values of the queue length and waiting time processes and show 
that the in the Halfin-Whitt regime, the diffusion scaled stationary value 
of the queue length converges to a limiting random variable corresponding 
to the stationary measure of a Markov chain, which, interestingly, may be 
recovered from our limit as well. Kaspi and Ramanan [12] consider service 
time distributions with a density and provide a fluid limit for the measure- 
valued process which keeps track of the amount of time that each customer 
has spent in the system. Nevertheless, with the exception of the results of 
Kapsi and Ramanan [12], it does not appear that any of the aforementioned 
approaches may be easily extended to the case of general service time dis- 
tributions, and so to this date there has remained no general methodology 
for analyzing the G/GI/N queue in the Halfin-Whitt regime. This is the 
main contribution of the present set of papers. 

In particular, in this paper and its sequel [18], we provide two separate 
approaches for extending the results of Halfin and Whitt [6] to the G/GI/N 
queue. Each of these approaches has its own unique set of advantages and 
disadvantages and in subsequent work we intend to provide important ap- 
plications in which one approach may be more advantageous than the other. 
For the remainder of the present paper we focus our attention on the first 
approach which we label the "Infinite Server Queue System Equations" ap- 
proach and defer discussion of the second approach, the "Idle Time System 
Equations" approach, until the sequel. 

The main insight to the "Infinite Server Queue System Equations" ap- 
proach is to write the system equations in a manner similar to the system 
equations for the G/ GI /oo queue. Proposition 2.1 in Section 2 then provides 
a crucial link between our system and the G/ GI/ oo queue which allows the 
asymptotic analysis to proceed. In an effort to give a quick idea of what our 
main results, first recall the heavy traffic results found in Borovkov [2] and 
Krichagina and Puhalskii [14]. Recall that heavy traffic for the G/ GI/ oo 
queue is defined by letting the arrival rate to the system grow large while 
holding the service time distribution fixed. In such a regime, it can be shown 
that the properly centered and scaled queue length processes will converge 
to a Gaussian process which we denote by Qi. 

Let us therefore denote by Qi the limiting Gaussian process obtained for a 
G/ GI /oo queue with the same sequence of arrival processes and an identical 
service time distribution as in our original sequence of G/GI/N queues. 
Then the limiting process of Theorem 5.1 of Section 5 for the properly 



4 



J. REED 



centered and scaled queue length process in our original sequence of G/GI/N 
queues is given by the unique strong solution to 



for t > 0, where Q + = max(<2,0), F is the CDF of the service time distri- 
bution, F e is the equilibrium distribution associated with F [see (5.4)] and 
Mq is an additional process which is related to the initial conditions of the 
queue. Note that the additional integral term on the right-hand side of (1.1) 
is naturally positive as one would expect more customers in a G/GI/N 
queue than in a corresponding G/GI /oo queue. Corollary 5.2 in Section 5 
also shows that (1.1) may be equivalently expressed as 



for t > 0, where £ = Mq + Qj, Q~ = min(0, Q) and M is the renewal function 
associated with the pure renewal process with interarrival distribution F. 
From (1.2), it is then a matter of a few direct calculations to recover Halfin 
and Whitt's original results. We also point out that in Section 4 we develop 
fluid limit results which closely resemble (1.1) above. 

The methodology of proof used in the present paper is heavily influenced 
by the results found in [14]. In particular, the authors in [14] use martingale 
techniques in order to show that certain processes associated with the queue 
length process are tight. In this paper, many of these same arguments are re- 
peated again but with the slight modifications necessary in order to account 
for the finiteness of the number of servers. We therefore encourage the inter- 
ested reader to concurrently review the results found in [14] in order to gain 
a fuller understanding of the present paper. In particular, one of the main 
insights from [14] is to show that the limiting process of Qj in (1.1) may be 
decomposed into a sum of two processes M\ and M%, which represent the 
randomness arising from the arrival process and service times, respectively. 
Furthermore, the process M^ may represented as a double integral against 
the Kiefer process. 

The remainder of this paper is now organized as follows. Section 2 provides 
the system equations for the G/GI/N queue. In Section 3, we provide a 
regulator map result upon which our weak convergence argument will hinge. 
Sections 4 and 5 contain our weak convergence results for the queue length 
process. Specifically, in Section 4 we study the queue length process under 
fluid scaling and our main result in this section is Theorem 4.1. Next, in 
Section 5, we study the fluid centered queue length process under diffusion 
scaling in the Halfin-Whitt regime and our main result there is Theorem 
5.1. Corollary 5.2 of Section 5 also provides an equivalent characterization 



(1.1) 




(1.2) Q(t) = ((t)+ C(t-*)dM(s)-pt 
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of the limiting process obtained in Theorem 5.1. This then serves as the link 
between Halfin and Whitt's results and ours. In Section 6, we conclude by 
providing several directions for future research. The Appendix also includes 
several proofs which are similar in nature to those found in [14] but are 
necessary for our results and so are included here for completeness. 

1.1. Notation. In what follows, all random variables are assumed to be 
defined on a common probability space (O, T, P). Stochastic processes are 
assumed to measurable maps from (0,,J-) to (D[0,oo),T>), where -D[0,oo) is 
the space of all right continuous with left limit (RCLL) functions on [0, oo) 
and V is the Borel a-algebra generated by the Skorohod Ji-topology, see 
Chapter 16 of [1] for further details. 

We denote by £>(M), the Borel cr-field on R. For any two measure spaces, 
(Si, Si) and (52,52), we denote by (Si x 52, Si x 52), the product measure 
space which is endowed with the product cr-field, Si x 52- Specifically, we 
define (D k [0, 00), V k ) to be the product measure space (D[0,oo) x ••• x 
D[0,oo),Vx ■■■ xV). 

We denote by dj l , the Skorohod metric on D[0, 00) and by u the uniform 
metric. For each x G -D[0, 00) and T > 0, we denote by 

\\x\\t = sup 

0<t<T 

the supremum metric on [0, T\. We also denote by | • |, the Euclidian metric 
on R. For any two metric spaces, (Si, mi) and (52, m 2 ), we denote by (Si x 
52, mi x 7712), the product metric space which is endowed with the maximum 
metric mi x m2 defined by 

(mi x m 2 )((xi,x 2 ),(yi,y2)) = max{mi(xi, yi) , 7712(^2,2/2) }• 

In particular, we define (D k [0, 00), d^) to be the product metric space 
(D k [0,oo),d k Jl ) = (D[0,oo)x---xD[0,oo),d Jl x---xdj 1 ) and we set (D k [0,co), 
u k ) = (D[0, 00) x • • • x D[0, 00), u x ■ ■ ■ x u). 

2. System equations for the G / GI /N queue. In this section, we provide 
the system equation for the G/GI/N queue. One of the key insights from 
Halfin and Whitt [6] was that for large N, the GI/M/N queue will, for 
stretches of time when the number of customers is low, behave as if it were 
an GI/M/ 'oo queue. Our main results in Sections 4 and 5 show that the same 
holds true for the G/GI/N queue as well. Our first step towards showing 
that this is the case is to write down the system equations for the G/GI/N 
queue in a similar way to those for the G/GI/ 00 queue. For the reader's 
convenience, we will closely adhere to the notation used in [14] as many of 
the arguments we use here cite results from that paper. 
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Initially, at time 0—, we assume that there are Qq customers in the sys- 
tem. The first mm(Qo, N) of these customers will be in service and the 
remainder are waiting to be served. Those customers in service at time 0— 
have already been in service for some amount of time and we denote by fji 
the residual service time of the ith customer in service at time 0—. We as- 
sume that {fji,i > 1} is an i.i.d. sequence of random variables with common 
distribution Fq. 

Customers next arrive to the system according to the arrival process A = 
{A(t),t > 0} and are served on a first come first served (FCFS) basis. The 
arrival time of the ith customer is defined to be the quantity 

Tj = inf{i > 0:A(t) > i}, i>l. 

Setting ro = 0, we also define 

(2.1) Ci = n-n-i, i>i, 

to be the interarrival times between the (i — l)st and ith customers to arrive 
to the system. 

The ith customer to enter service after time 0— is assigned the service 
time r]i. We assume that {r]i,i > 1} is an i.i.d. sequence of mean 1, random 
variables with common distribution F whose tail distribution we denote 
by G = 1 — F. Note that we impose no assumptions on the service time 
distribution, other than it have a finite first moment. 

For each i > 1, let Wi denote the waiting time of the ith customer to 
arrive to the system after time 0— and let Wi denote the waiting time of 
the (N + i)th initial customer in the system at time 0—, if such a customer 
exists. We begin our indexing by N + 1 since the first iV initial customers in 
the system will not have to wait. Using this notation as well as that of the 
previous paragraphs, the total number of customers in the system at time t 
is given by 

vam(Q ,N) (Qo~N)+ 

Q(t)= Hw>t}+ J2 H™i + Vi>t} 

i=l i=l 
A{t) 

+ 1 i T « + w i+ V(Q -N)++i > t}. 
i=l 

We henceforth refer to the process Q = {Q(t),t > 0} as the queue length 
process. It is important to note that Q does not only count those customers 
in the queue waiting to be served but that indeed it counts the total number 
of customers in the system. The number of customers waiting to be served 
may however be recovered from Q and is given by (Q — N) + . Also note that 
in general Qo / Q(0) since it is possible for customers to arrive to the system 



(2.2) 
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at time zero. One may think of Qq as being equal to Q(0— ), the left-hand 
limit of Q at time t = 0. 

Centering each of the indicator functions in the first summation on the 
right-hand side of (2.2) by the means and the indicator functions in the 
last two summations by their means conditional on their arrival times and 
waiting times, we obtain 

Q(t) = mm(Q ,N)F (t) + W (t) + M 2 (t) 

(2.3) 

(Qo-N)+ A(t) 

+ J2 G(t-Wi) + j2G(t-Ti-Wi), 

i=l i=l 

where 

min(Q o ,A0 

(2.4) W (t)= £ (l{fji>t}-F (t)) 

i=i 

and 

(Qo-N)+ 

M 2 {t) = (l{wi + Vi>t}-G(t-Wi)) 

i=i 

A(t) 

+ + W i + V(Q -N) ++i ><} - G (t ~ T i~ W i))- 

i=l 

We also set W = {W {t),t> 0} and M 2 = {M 2 (t),t> 0}. 
Next, adding in and subtracting out the terms 

(2.6) A G (t) = I G(t-s)dA(s) 

Jo 

and {Qq — N) + G{t) both to and from the right-hand side of (2.3), we obtain 
Q(t) = I(t) + W (t) + M 2 {t) + A G (t) 
{Qo-N)+ 

(2.7) + £ (G(t-m)-G(t)) 

i=l 
A(t) 

+ (G(t -n- - G(t - n )), 

i=l 



(2.5) 



where 



I{t) = min(Q , N)F (t) + (Q - N) + G(t). 



Note that Ac(t) as given in (2.6) is the expected number of customers 
in G/GI/oo queue at time t with same arrival process and service time 
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distribution as in our Gf GI/N queue conditional on the arrival process A. 
We also set A G = {A G (t),t>0} and 1 = {I(t),t > 0}. 
We now have the following key proposition. 

Proposition 2.1. For each t>0, 

A(t) 

^(Git-Ti-Wij-Git-n)) 
1=1 

r t (Qo-N) + 

= (Q(t - s) - N) + dF(s) - (G(t-Wi)-G(t)). 
J o i=l 

Proof. First note that for each time t > 0, we have that the total num- 
ber of customers waiting to be served at time t may be written as 

(Qo-N)+ A(t) 
(Q(t)-N) + = Ht<ti l } + Y 1 {Ti<t<T i +w i }. 

i=l i=l 

We therefore have that 

A(t) 

Y(G(t-r i -w l )-G(t-T i )) 
i=i 

m rt- Ti 

= E / dF ( s ) 

i = 1 J(t-{Ti+Wi)) + 

A(t) 



"-w poo 

V / l{t - (n + Wi ) < s < t - Ti} dF(s) 
i=i J o 

Hn<t- s<Ti + Wi } dF(s) 



i=l 



roc v ' 

/ Vl{ri<t-s<ri + u;i}a!F(s) 
J ° i=l 

r t ( (Qo-N)+ x 

y o UQ(t - s )-n) + - J2 > t - *} J dF ( s ) 

r t r t(Qo~N)+ 

{Q(t-s)-N) + dF(s)- V l{ Wi >t-s}dF(s). 
Jo Jo i=1 
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A reverse argument can now also be used to show that 




l{wi>t-s}dF(s)= ]T (G(t-Wi)-G(t)) 




This completes the proof. □ 

Proposition 2.1 now allows us to rewrite equation (2.7) for the queue 
length at time t as 



Equation (2.8) is the starting point for our analysis in Sections 4 and 5. In 
the next section, we develop a family of regulator map results which will be 
useful in representing the queue length process in (2.8). 

3. A family of regulator map results. In this section, a family of regu- 
lator map results are provided which will be relied upon in the proof of our 
main results. In particular, these maps will provide convenient representa- 
tions for the queue length processes in Sections 4 and 5. 

Let B be a cumulative distribution function on R and let a£K. For each 
x G D[0, oo), we would like to find and characterize solutions z S D[0, oo) to 
equations of the form 



We therefore define the mapping (p a B : D[0,oo) i— » D[0,oo) to be such that 
f%(x) is a solution to (3.1) for each x £ D[0, oo). The following proposition 
now shows that (fg is uniquely defined and provides some regularity results 
for as well. Its proof may be found in the Appendix. 

Proposition 3.1. For each x € D[0,oo), there exists a unique solution 
<p%(x) to (3.1). Moreover, the function ip a B : D[0, oo) i— > -D[0, oo) is Lipschitz 
continuous in the topology of uniform convergence over bounded intervals 
and measurable with respect to the Borel a -field generated by the Skorohod 
J\ topology. 

4. Fluid limit results. In this section, we obtain a nonlinear convolution 
equation as the fluid limit for the queue length process of the G/GI/N 
queue in the Halin-Whitt regime. The limit which we obtain may be seen to 
be decomposed into four separate parts, one of which is the corresponding 



(2.8) 



Q(t) = l{t) + W (t) + M 2 (t) + A G (t) 
+ f\Q(t-s)-N) + dF(s). 



Jo 



(3.1) 




t > 0. 
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fluid limit for a Gj GI /oo queue with the same sequence of arrival processes 
as our G/GI/N queue and also with the same service time distribution. 
Although in many cases our fluid limit may not be directly solved for, we 
also present a special case in which it can which also highlights the rather 
unconventional behavior which our fluid limits may display. 

Our underlying premise is that we are considering a sequence of G/GI/N 
queues which we index by the number of servers N. In general, we will use 
a superscript N to denote all processes and quantities associated with iVth 
system. 

Initially, at time 0—, there are Qq customers in the iVth system. The 
residual service time distribution of those customers in service in the iVth 
system at time 0— are i.i.d. with common distribution Fq. We denote by 
{fjiii > 1} the i.i.d. sequence of residual service times. 



Customers arrive to the iVth system according to the arrival process ^4 = 
{A N (t),t>0}. We denote by 



the time of the arrival of the ith customer after time 0— to the iVth system. 
The ith customer to enter service after time 0— in the iVth system is assigned 
the service r^, where {rji,i > 1} is an i.i.d. sequence of random variables with 
common distribution F. Finally, we denote by G = 1 — F the tail distribution 
of F. Note that neither the sequence of residual service times or actual 
service times is changing with N . 

For the remainder of this section, we study the fluid scaled queue length 
process Q N = {N~ 1 Q N (t),t > 0}. Our high level approach will be similar 
in spirit to fluid limit proofs for the queue length process in conventional 
heavy-traffic in which the number of servers remains fixed but the service 
rate is increased. In particular, we first provide a representation of the queue 
length process in terms of the regulator mapping tp^ provided by Proposition 
3.1 and an associated free process, say X. We then provide several weak 
convergence results related to X which may be used in conjunction with 
the Continuous Mapping theorem and the representation in terms of ipp in 
order to establish the main result of the section, Theorem 4.1, which details 
the asymptotic behavior of the fluid scaled queue length process. 

Let Q N = {Q N (t),t > 0} be the queue length process in the iVth system 
and recall that by equation (2.8) of Section 2, we have that 



rf = inf {* > : A 



(t) > i] 



(4.1) 



Q N (t) = I N (t) + W$ (t) + M 2 W (t) + A; 



N G {t) 
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I N {t) 



I N (t) 
W N (t) 



(4.3) Mf(t) 
and 



N ' 
W Q N (t) 
N ' 



N 

Nr. 



N 



(4.4) ^(t) 

it then follows from (4.1) that 

Q N (t) = I N (t) + W N (t) + Mf(i) + ^(t) 

(4.5) 



[\Q N (t-s)-l) + dF(s) 
Jo 



Furthermore, since by Proposition 3.1, the mapping (fp is uniquely defined 
with a = — 1 , setting 

Q JV = {Q Ar (t),t>0}, 
I N = {I N (t),t>0}, 
W N = {W N (t),t>0}, 
M$ r = {M* r (t),t>0} 

and 

^(t) = {^(*),t>0} ) 

we have from (4.5) that 

(4.6) Q N = ip a F {I N + W N + M 2 N + 

with a = — 1. The representation (4.6) above will turn out to be useful when 
proving the main result of this section. 

We now state several preliminary results in preparation for the statement 
of the main result of the section, Theorem 4.1. Our first result shows that 
Wq converges to zero as N goes to oo. 

Proposition 4.1. Wq =^ as N — > oo . 

PROOF. First, note that 

Nmin{N~ 1 Q^,l) 

W N (t) = N- 1 £ (l{m>t}-F (t)). 

i=l 
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Thus, for each T > and 5 > 0, we have 

7Vmin(A r-1 Qg r ,l) 



sup 

, 0<t<T 



N' 



(l{fj i >t}-F (t)) 



i=l 



>s 



< P sup sup 

\0<z<10<t<T 

However, by Lemma 3.1 in [14], 

[xN\ 



[xN} 

n- 1 (m > t} - F (t)) 

i=l 



P sup sup 

\o<x<io<t<r 



n- 1 Yl(m>t}-m)) 



i=l 



>5 



>5 



as N — > co, 



which completes the proof. □ 



We next show that converges in distribution to zero. The full proof 
of this result may be found in the Appendix. 

Proposition 4.2. =^0 as N — > co. 

Proof. See the Appendix. □ 

The following is now the main result of this section. It provides a de- 
terministic first-order approximation to the queue length process. Later, in 
Section 5, we use this result to center the queue length process and obtain 
a second-order approximation. 

Let 



Qo ~ at 



be the fluid scaled initial number of customer in the system at time 0— and 



A N (t) 



A N (t) 



N 



be the fluid scaled number of arrivals by time t > 0. We also set A N = 
{A N (t),t > 0} to be the fluid scaled arrival process. We then have the fol- 
lowing. 

Theorem 4.1. // (Q$,A N ) (Q ,A) in (R x D[0,oo),| • | x d, h ) as 
N — > co, where A is a stochastic process with F-a.s. continuous sample paths, 
then Q N =4> Q as N — > co, where Q is the unique strong solution to 

Q(t) = min(Q , l)F (t) + (Qo - 1) + G(t) 

(4.7) 



+ / G{t-s)dA(s)+ / {Q{t-s)-l) + dF{s 



for t > 0. 
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Proof. First, note that by the definition of in (4.4) and the assump- 
tion of the theorem that A N =4> A as iV — > oo, where A has P-a.s. continuous 
sample paths, it follows as in the proof of Theorem 3 of [14] that 

Aq = [ G(--s)dA N (s) 

(4-8) 



/ G{--s)dA(s) 
Jo 



as iV — > oo. Next, setting 



M 3 N = W N + Mi f + 
it follows by Propositions 4.1 and 4.2 and (4.8) that 

A? 3 7V => / G(- - s) dA(s) as N -» oo. 

JO 

Since, by assumption, (Q^,^) =>■ (Qo>^4) m (R x £>[0,oo),| ■ | X dj t ) as 
iV — > oo, it now follows by Theorem 11.4.5 in [20] that 

(M^Q^Qf G(-- S )<L4»,Q ) in (R x D[0,oo), | • | x djj 

as N ^ oo. By Theorem 11.4.1 in [20], the space 1 x D is separable under 
the product topology induced by the maximum metric | - | x dj 1 and thus, 
by the Skorohod representation theorem [20], there exists some alternate 
probability space, (Q,JF, P), on which are defined a sequence of processes 

(4.9) {(M 3 N ,Q»),N>1} 
such that 

(4.10) (M 3 N ,Q^)^(M 3 N ,Q^) foriV>l, 
and also processes 

(4.11) (J G{- - s) <L4», Q ) = (J G(- ~ s) dA(s),Q ^j , 
where 



(4.12) 

in (R x D, \ • | X dj-A) P-a.s. 

as N — > oo. Furthermore, as the process J G(- — s) dA(s) on the right-hand 
side of (4.12) is, by the assumption of the continuity on A, continuous, it fol- 
lows that the convergence in (4.12) can also be strengthened to convergence 
in (Rx DA ■ | x u). 
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Now set 

i N = mm(Q$,l)F + (Q$-l)+G 
and note that by (4.10), we have 

(4.13) (M.f,i N ) = (M.^J N ) £6rJV>l. 

Furthermore, letting 

/ = min(g ,l)F + (Q -l) + G', 
we have for each T > 0, by (4.12), 



sup \I N (t)-i(t)\ = sup |(min(Q^,l)-min(g ,l))F (i) 

0<t<T 0<t<T 

(4.14) 



< |Q^-Qo| sup (F (t) + G(t)) 

0<t<T 

< 2\Q$-Q \ 

(4.15) -^0 P N — > oo. 
Now let 

Q N = cp a F (i N + Mi r ), 

where a = —1, and note that by the representation (4.6), (4.9), (4.13) and 
the measurability of (p F from Proposition 3.1, it follows that 

(4.16) Q N = Q N farJV>l. 

Furthermore, it follows from (4.12), (4.14) and the continuity of ip F with re- 
spect to the topology of uniform convergence over compact sets from Propo- 
sition 3.1, that 

<p a F (min(Q , 1)F + (Qo - 1) + G + J G{- - s) dA{s)\ 

in (D[0,oo),m) P-a.s. as N — > oo. Thus, since convergence in (D,u) im- 
plies convergence in [D^dj^ and almost sure convergence implies conver- 
gence in distribution, it follows by the measurability of ip F : (D[0, oo),X>) i— > 
(D[0,oo),T>) from Proposition 3.1 and (4.16) that 

Q N => ip a F (mm(Q , 1)F + (Qo - 1) + G + J G(- - a) (M(s)) as TV oo, 
which completes the proof. □ 
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Note that the fluid limit Q given by (4.7) of Theorem 4.1 may be decom- 
posed into four separate parts. The first two terms on the right-hand side 
of (4.7) are representative of the fluid scaled number of customers in the 
queue at time 0—. Specifically, mm(Qo,l)Fo(t) is the limiting fluid scaled 
number of customers who were in the service at time 0— and still remain in 
the system at time t and (Qo — 1) + G(t) is representative of those customers 
who were waiting in the queue to be served at time 0—. Next, the term 
/q G(t — s)dA(s) may be viewed as the limiting fluid scaled number of cus- 
tomers in the system at time t in an Gj GI/oo queue with the same sequence 
of arrival processes and service time distribution as in our G/GI/N queue 
and which starts out empty at time 0—. Finally, the integral term on the 
right-hand side of (4.7) may be thought of as an adjustment to the infinite 
server term immediately preceding it which takes into account the waiting 
times of customers. 

In general, the limiting process of Theorem 5.1, Q, cannot be directly 
solved for. This is mainly due to the presence of the nonlinear () + operator in 
the integral term. However, under certain special circumstances it can. The 
following example now presents one such case in which an explicit solution 
may be found. 

Example 1. Consider the case of deterministic service times in which 
we have Qo = 1 and A = e. Further, we also assume that the residual service 
times are constant with mean equal to 1 so that Fq(x) = F(x) = l{x > 
l},x > 0. In this case, (4.7) takes the rather simple form 

(4.17) Q(t) = l + t, 0<t<l, 
and 

(4.18) Q(t) = l + (Q(t)-l) + , t>l. 
Solving this recursion, one finds that 

(4.19) Q(t) = l + t- [t\, t>0. 

Thus, Q exhibits the sawtooth pattern as shown in Figure 1 above. Note the 
rather unconventional nature of the fluid limit in Figure 1. In particular, it 
is periodic with a period of 1 and it is also discontinuous. Thus, our limit 
process may in general display rather irregular behavior. However, as is 
shown in Section 5 below, if one starts out the queue length process under 
general "equilibrium" conditions, then much more regular behavior of the 
fluid limit may be obtained. 
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5. Diffusion limit results. In this section, we obtain limiting results for 
the G/GI/N queue in the Halfin-Whitt regime. Our main result of the 
section is to provide a limiting approximation for the diffusion scaled queue 
length process in this regime. This limiting approximation may be viewed 
as the solution to a stochastic nonlinear convolution equation. In order to 
proceed, we first express the queue length process for the G/GI/N queue via 
the regulator map ipp defined in Section 3. We then provide several useful 
propositions in preparation for the statement of our main result, Theorem 
5.1, which provides a limiting approximation for the diffusion scaled queue 
length process. In Corollary 5.2, we provide an alternative representation 
of the limiting process obtained in Theorem 5.1. This representation has 
several desirable properties and we conclude the section by showing how in 
the case of exponentially distributed service times and renewal arrivals it 
reduces to the diffusion obtained by Halfin and Whitt [7]. 

5.1. The Halfin-Whitt regime heavy-traffic regime. In order to proceed, 
we must first provide a detailed description of the Halfin-Whitt regime. 
Our setup is similar to Section 4 where we obtained our fluid limit results. 
Again, we consider a sequence of G/GI/N queues indexed by the number 
of servers N. Initially, at time 0—, there are Qq customers in the system 
and the first min^^, N) of these customers have i.i.d. residual service times 
with common distribution Fq. We denote by % the residual service time of 
the ith customer in service at time 0—. 

Customers arrive to the iVth system according to the arrival process A N = 
{A N (t),t> 0} and we denote by 

t, N = mf{t>0:A N (t)>i}, i>l, 

the time of the arrival of the ith customer after time 0— to the iVth system. 
We also assume that there exists a sequence of constants {p N ,N > 1} such 
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that p n — > 1 as N — > oo, and, where, setting 

r«r . . A N (t)-N P N t 

(5.1) -A (*) = ^ , t>0, 



,'N 

and = {^(i),* > 0}, we have that 

(5.2) A N =>£ asiV^oo, 

where £ is a stochastic process with P-a.s. continuous sample paths. Loosely 
speaking, one may interpret p as the arrival rate of customers to the iVth 
system. 

Note that assumption (5.2) is flexible from a modeling point of view. In 
heavy traffic theory, one often assumes that A N (e) = A(Ne), where A is a 
renewal process, in which case, by Donsker's theorem, the process £ in (5.2) 
turns out to be a Brownian motion. The interpretation this assumption is 
that customers are emanating from a single source, albeit at a rapid rate. 
However, in many applications, with telephone call centers being just one 
such example, it is perhaps more natural to assume that customers are 
emanating from many sources. This then leads to the assumption that A N 
is a superposition of many i.i.d. renewal arrival processes, that is, = 
Y^i=i Ai- Under such an assumption, the process £ turns out to be a centered 
Gaussian process whose covariance structure is inherited from that of each 
of the individual A^s. The interested reader is referred to Section 7.2 of [20] 
for further details on this remark. 

As in Section 4, the service time distribution is held fixed as we index 
through N. We therefore denote by rji the service time of the ith customer 
to enter service after time 0—, where {r]i,i > 1} is an i.i.d. sequence of mean 
1 random variables with common distribution F. We denote by G = 1 — F 
the tail distribution of F. Note also that we place no additional restrictions 
on F beyond a first moment. 

It now remains to provide the key relationship characterizing the Halfin- 
Whitt regime. As noted above, we have that by (5.1) and (5.2), the quantity 
Np may be loosely interpreted as the arrival rate to the iVth system. 
Next, since there are ./V servers in the Nth system and it is assumed that 
the service rate is fixed at one, it also follows that p N may also be interpreted 
as the traffic intensity of the iVth system. The Halfin-Whitt regime is now 
achieved by specifying the rate at which the traffic intensity of the system 
converges to one as N grows to infinity. Specifically, we assume that 

N\ 



(5.3) VN(1 - p ls ) -> (3 as N -»• oo, 



where — oo < [3 < oo. 
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5.2. Initial conditions. In proving our main diffusion limit result, it will 
be useful to assume that the limiting fluid scaled number of customers in 
the system is constant for all t > 0. Let 

(5.4) F e (x)= [ G(u)du, x>0, 

J o 

be the equilibrium distribution associated with F. The following result may 
now be seen as a corollary to Theorem 5.1 of Section 4. 

Corollary 5.1. If F = F e and Qq =^ 1 as N —> oo, then Q N =!>1 as 
N ^ oo. 

PROOF. First note that (5.1), (5.2) and the Halfm-Whitt assumption 
(5.3) imply the functional weak large of law large numbers result, A N 4>e as 
N — > oo, where e = {t, t > 0} is the identity process. Thus, by Theorem 3.9 in 
[1] and the assumption Qq =4> 1 as N — ► oo, we have that (Qq , A N ) =>■ (1, e) 
in (R x D, | • | x dj ± ) as N — > oo. 

It now follows by Theorem 5.1 in Section 4 that =>• Q as N —> oo, 
where Q is given by the unique solution to 

Q(t) = min(l, l)F e (t) + (1 - l) + G(t) + / G(t - s) de(s) 

Jo 

+ / (Q(t - s) - 1) + dF(s) 
Jo 

rt ft 
= F e (t)+ / G(t-s)ds+ / (Q(t-s)-l) + dF(s) 
Jo Jo 

= 1+ f t (Q(t-s)-l) + dF(s) 
Jo 

for £ > 0. By inspection, one sees that Q(t) = 1 for t > is the unique solution 
to this equation, which completes the proof. □ 

For the remainder of this section, we assume that the simplifying as- 
sumptions of the above corollary hold. That is, we assume that the initial 
residual service time distribution is equal to the equilibrium distribution F e 
and that Q N =4> 1 as iV — > oo. In future papers, we intend to remove these 
assumptions. 

5.3. Weak convergence results. We now proceed to provide our weak 
convergence results. We begin by providing a convenient representation for 
the queue length process in terms of the regulator map of Proposition 3.1. 
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Recall that by equation (2.8) of Section 2, we have that the queue length at 
time t may be written as 

Q N (t) = I N (t) + W N (t) + M?(t) + A%{t) 

(5.5) 

+ / (Q N (t-s)-N) + dF(s). 
Jo 

We would next like to the center the queue length process by its fluid 
limit, appropriately scaled. By Corollary 5.1 above, we have that the limiting 
fluid number of customers in the system, Q, is equal to 1 for all t > 0. We 
therefore choose to center the queue length process in the iVth system by 
N. Performing such a centering as well as some algebraic manipulations and 
recalling the definition of F e from (5.4), one then obtains that 

Q N (t) -N = Mg (t) + H N (t) + W£<(t) + MF(t) + Mf (t) 

(5.6) 

-N(l-p N )F e (t)+ f (Q N (t-s)-N) + dF(s), 
Jo 

where 

M»(t) = (Q$-N) + (G(t)-F e (t)), 
H N (t) = (Q$-N)F e (t) 

and 

(5.7) M?{t)= f G{t-s)d(A N (s)-Np N s). 

Jo 

Let = {Mg(t),t>0},H N = {H N (t),t>0} and M? = {M?(t),t > 0}. 
If we now define the diffusion scaled quantities, 



(5.8) 



and 
(5.9) 



Q N (t) = 


Q N (t) - 


M% (t) = 


Vn ' 


H N (t) = 


H N (t) 

Vn ' 


W N (t) = 


W Q N (t) 

Vn ' 


Mf(t) = 






Mf (t) 



N 
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it then follows, dividing (5.6) by y/N, that 

Q N (t) = Mq (t) + Qf (t) - VN(1 - P N )F e (t) 

(5.10) 

+ / Q N ' + (t-s)dF(s), 
Jo 

where 

Qf (t) = H N (t) + W Q N {t) + Mf(i) + Mf(t). 

Letting 

Q Ar = {Q Ar (t),t>0}, 
M% = {M%(t),t>0}, 

H N = {H N (t),t>0}, 
W N = {W N (t),t>0}, 
M 2 N = {M 2 N (t),t>0}, 
Aff = {M 1 Ar (t),t>0} 

and 

we then have, since the mapping ^ with a = is by Proposition 3.1 uniquely 
defined, that (5.10) may also be written as 

(5.11) Q N = <p a F (M$ + Qf- y/N(l - p N )F e ), 

with a = 0. 

The representation (5.11) will be useful in the proof our main result. How- 
ever, before stating this result, we first provide several preliminary proposi- 
tions and lemmas which are interesting in their own right and will be crucial 
in the proof of our main result. 

The proof of the following result may now be found in the Appendix. 
It provides a limiting process which represents the randomness of the ser- 
vice times in the limit. For further details on the limit process below, the 
interested reader may consult [14]. 

Proposition 5.1. Let 

Nt 

M^(t) = N- 1 ' 2 Y^0-{N~H + m>t}~ G(t - N~ l i)), t > 0, 
i=i 

and set = {M^(t),t> 0}. Then, 

(M 2 Ar ,M 2 Ar )^(M2,M2) in {D 2 [0,00),^) as 00, 



THE G/GI/N QUEUE IN THE HALFIN-WHITT REGIME 21 
where M 2 is a centered Gaussian process with covariance structure 

E[M 2 {t)M 2 {t + 5)} = [ G(t + S-u)F(t-u)du fort,S>0. 
Jo 

Proof. See the Appendix. □ 

We next prove a joint convergence result on the diffusion scaled processes 
defined at the beginning of this section. Let 

(5.12) QN=Qo-N 



N 

be the diffusion scaled number of customers in the system at time 0—. 

Next, let Wo = {Wo(t),t > 0} be a Brownian bridge. In other words, Wo 
is the unique continuous, centered Gaussian process on [0, 1] with covariance 
function 

E[W (s)W Q (t)] = (s A t) - st, < s < t < 1. 

Moreover, set Wo(F e ) = {Wo(F e (t)),t > 0}, where F e is the equilibrium dis- 
tribution associated with F as defined in (5.4). One may view Wo(F e ) as a 
time changed Brownian bridge. 
We then have the following result. 

Proposition 5.2. If Qq =>■ Qo as N^oo, then 

(Qo W ,W N ,A N ,M 2 N ) (Q ,W (F e ),lM 2 ) in (R x D 3 [0, oo), | • | x d\) 

as N — > oo, where each of the limiting processes appearing on the right-hand 
side above are independent of one another. 

Proof. We first show convergence of the marginals. The convergence 
of Qq to Qo is clear by assumption (5.12). 
Let 

N 

w N (t)=N- i / 2 Y / (m>t}-F e (t)) 

i=l 

and set W N = {W N (t),t > 0}. The convergence 

(5.13) (W^W*) => (W (F e ),Wo(F e )) in (£> 2 [0, oo), d\) as oo, 
follows by the representation 

7Vmin(Ar- 1 Q^,l) 

w N (t)=N- 1 / 2 (m>t}-F e (t)), 

i=l 
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the Random Time Change theorem [1] and Lemma 3.1 of [14], since, by the 
Continuous Mapping theorem and assumption (5.12), 

min^g^l)^! asiV^oo. 

The convergence of to £ follows by assumption (5.2) and the convergence 
of M 2 to M 2 is immediate by Proposition 5.1. 

It remains to show the joint convergence as stated in the proposition. The 
convergence 

(Qfi ,W? ,A N ,M?) =► (Q ,W (F e ),Z,M 2 ) in (R x £> 3 [0,oo),| ■ | x d\) 

as N — > 00, follows by Theorem 11.4.4 in [20] since each of the component 
processes appearing in the prelimit above are independent of one another 
and further, they converge to their desired limits as shown in the previous 
paragraph. Next, note that 

< d h (W N , W N ) + d. h {M?,M?) 
and thus, if we can show that 

(5.14) dj, (W/, Wg) + d Jt (Mf, ) ^0 as N 00, 

then by Theorem 11.4.7 in [20] the proof will be complete. However, (5.14) 
follows by (5.13), Proposition 5.1 and Theorem 11.4.8 in [20]. The proof is 
now complete. □ 

We are now ready to state the main result of this section. Assume first 
that Qq =4> Qq as N — > 00 and let 

(5.15) H = Q F e and M Q = Q+(G-F e ). 
Next, set 

(5.16) Mi(i)= f G(t- s)di(s), t>0, 

Jo 

and Mi = {Mi(t),t > 0}, where the process £ appearing in (5.16) is the 
limiting process appearing in (5.2) at the beginning of this section. Note 
also that the integral above may be interpreted as the result of integration 
by parts. 

Next, let j3F e be the process {/3F e (t),t > 0}, where we recall the definition 
of F e from (5.4) above. 
Finally, let 



(5.17) 



Q! = H + W (F e ) + Mi + M 2 . 
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Note that by Theorem 3 of [14], Qj is the limiting queue length process 
associated with a sequence of G/GI/oo queues with identical arrival pro- 
cesses and service time sequence as our original sequence of Gj GI/N queues 
and with Qq customers in service at time zero with residual service time 
distribution F e . 

The following is now our second main result. 

Theorem 5.1. If the residual service time distribution Fq = F e and 
Q$ =>• Q as oo, then Q N ^%(Mq + Qi~ fiF e ) as N -> oo. 

Proof. Let /:MxD 3 ^Kx£) 3 be the map defined for (x\, x 2 , X3, x±) £ 
R x D 3 by 

(5.18) /((X1,X 2 ,X 3 ,X 4 )) = (fl(x 1 )J 2 (X2)j3(x 3 )j4(X4)), 

where fi(xi) = xi,/ 2 (x 2 ) = x 2 , fi(xi) = x 4 and 

(5.19) f 3 (x 3 )(-)= fG(--s)dx 3 (s), 

Jo 

where the above integral above may be interpreted as the result of integra- 
tion by parts. 

Next, note that since by assumption Fo = F e and Qq Qo as N — > 00, 
it follows by Proposition 5.2 that 

(5.20) (Q W ,W N ,A N ,M 2 N ) (Q ,W (F e ),i,M 2 ) 

in (R x D 3 [0,oo), | - | x d 3 ) as N — > 00, where each of the limiting processes 
above are independent of one another. Furthermore, we have that each of the 
limiting processes above are P-a.s. continuous. Thus, since by Lemma A. 9 
of the Appendix, /:(R x L> 3 [0,oo),| • | x d\) 1— >• (R x L> 3 [0,cx)),| • | x d\) 
is continuous at continuous limit points (x\, x 2 , £3, X4) £lx D 3 [0,oo) such 
that x 2 ,X3,X4 E C[0, 00), we have that 

(5.21) P((Q ,W (F e ),lM 2 ) e Disc(f)) = 0. 

Now note by (5.1), (5.7), (5.9) and the definition of / in (5.18) and (5.19), 
we have the representation 

(Q^,W Q N ,Mr,M 2 N ) = f((Q^W N ,A N ,M 2 N )). 

It therefore follows by (5.20), the measurability of / : (R x D 3 [0, oo),Z3(R) x 
V 3 ) i-> (R x £) 3 [0,oo),£(M) x V 3 ) by Lemma A.9 in the Appendix, (5.21), 
the Continuous Mapping theorem [1] and the definition M\ in (5.16) that 

(Q$, Wg,M?,M?) =► (Qo,W (F e ),Mi,M2) 

in (R x -D 3 [0, 00), 0(R) x T> 3 ) as N — > 00, where each of the limiting processes 
appearing on the right-hand side above are independent of one another. 
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Next, since (R,R) and (D,T>) are both separable spaces, it follows by 
Theorem 11.4.1 in [20] that R x D 3 is separable under the product topology 
induced by the maximum metric | - 1 x d? Jl . Thus, by the Skorohod represen- 
tation theorem [20], there exists some alternate probability space, (Q,^F,P), 
on which are defined a sequence of processes 

{{Q»,W N ,M?M),N>1}, 

where 

(5.22) (Q$,W N ,M?, Mf) i (Q$, W N , M? , M-f ), N > 1, 
and also processes 

(5.23) (Q , Wo(F e ), Mi,M 2 ) = (Q , W (^e),Mi, M 2 ), 
such that 

(5.24) (Q^,W N , M?,M$) (Qo, T^o^e), Mi, M 2 ) 

in (R x .D 3 [0, oo), | • | x d j ) P-a.s. as iV — > oo. Furthermore, since each of the 
processes appearing on the right-hand side of (5.24) is continuous, we may 
assume that above convergence also occurs in (R x D 3 [0, oo), \ ■ | x u 3 ). 
Now, set 

M% = Q^ + {G-F e ) 

and 

M Q = Q+{G-F e ). 

It is then clear that 

sup \Mg(t)-M Q (t)\<\Qfi-Q Q \ sup \G(t)-F e (t)\ 

0<t<T 0<t<T 

<2\Q$-Q \, 

and so it follows by (5.24) that 

(5.25) Mq -> M Q in (D[0, oo), it) P-a.s. as N -> oo. 
Next, letting 

H N = Q$F e , 

a similar augment shows that 

(5.26) H N ^H in (D[0,oo),u) P-a.s. as iV^oo, 
where 

= QoFe- 
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Finally, it is clear by the Halfin-Whitt condition (5.3) and the boundedness 
of F e , that 

(5.27) y/N(l - p N )F e -»• pF e in (D[0,oo),u) P-a.s. 

as N — > oo. 
Thus, letting 

we have by (5.24)-(5.27) that 

(5.28) M% + Qf - y/N(l - P N )F e Mq + Qj - /3F e 
in (D[0,oo),u) P-a.s. as N^oo, where 

Q I = H + W(F e ) + M 1 + M 2 . 
Furthermore, it follows by (5.23) that 

(5.29) Mq + Qf - VN(1 - p N )F e = Mq +Qf - - p N )F e 

for N> 1. 

Now set 

(5.30) Q N = (p%(Mq + Qf - v^l - p^)^). 

Since by Proposition 3.1, the map ip F : (D[0,oo),T>) <— ► (_D[0,oo),D) is mea- 
surable, it follows by (5.11), (5.29) and (5.30) that 

(5.31) Q N = Q N , N>1. 

Furthermore, by the continuity portion of Proposition 3.1 and (5.28), 

(5.32) Q N = (p F (Mq +Qf- VN(1 - p N )F e ) - <p° F (M Q + Q T - f3F e ) 

in (D[0,oo),u) P-a.s. as N — > oo. Since convergence in (D[0,oo),u) im- 
plies convergence in (D[0, oo), dj x ) and almost sure convergence implies 
convergence in distribution, it now follows by (5.31), the measurability of 
<p° F : (D[0, oo), V) i ^ (D[0, oo),V) from Proposition 3.1 and (5.32) that Q N 
(P f (Mq + Qj — j3F e ) as N — > oo, which completes the proof. □ 

Note that the diffusion limit for the queue length process given by Theo- 
rem 5.1 may be written out in expanded form as the solution to the stochastic 
convolution equation 

(5.33) Q F {t) = M Q {t) + Qj(i) - f3F e (t) + f Q+{t - s) dF{s), t > 0. 

Jo 
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In this representation, we see that Qf may be decomposed into four separate 
parts. The second term on the right-hand side of (5.33), Qj, defined by 
(5.17) above, is the diffusion limit for the G/GI /oo queue with the same 
number of initial customers as in our G/GI/N queue and with the same 
sequence of arrival processes and identical service time distribution as in 
our Gf GI/N queue. It is the primary stochastic component which drives the 
convolution equation above. The third term on the right-hand side above, 
(3F e (t), arises out of the Halfin-Whitt condition (5.3). The first term on 
the right-hand side above, Mq, takes into account the discrepancy between 
the Gj GI/N and Gf GI/oo queue in the initial number of customers in the 
system at time 0— who remain in the system at time t. Finally, similar to 
as in the fluid limit of Section 4, the integral term on the right-hand side of 
(5.33) represents an adjustment term to the infinite server queue limit, Qj 
which takes into account the waiting times of the customers in the G/GI/N 
queue. Note also that the adjustment integral term is positive as one would 
expect since the number of customers in the G/GI/N queue will always be 
stochastically larger than in a corresponding G / GI /oo queue. Furthermore, 
only the positive portion of the queue length process, Qp, appears in the 
limit since it is only when there are more customers than servers in the 
system that the finite server approximation to the infinite server queue will 
be off. 

5.4. The virtual waiting time process. In this subsection, we study the 
diffusion scaled virtual waiting time process and the diffusion scaled cus- 
tomer waiting time process for the G/GI/N queue in the Haflin-Whitt 
regime. For each t > 0, let V (t) denote the hypothetical amount of time 
that a customer arriving to the Nth system at time t would have to wait 
before being served and, for i > 1, let denote the waiting time of the ith 
customer to arrive the system after time 0—. Note that denoting by D N (t) 
the number of departures from the iVth system by time t > 0, we have that 

V N (t) + t = inf{s > :£>*(«) > A N (t) + Q$} 

for t > and = V N {rf — ). In this subsection, we obtain asymptotic re- 
sults for the diffusion scaled virtual waiting time process 
t > 0} and the also for the diffusion scaled customer waiting time process 

V N (t) = {N l l 2 Vy^ t ^ ,t > 0}. Our main approach will be to leverage off of the 
results of Section 5.3 on the diffusion scaled queue length process. 

The main result of this subsection is the following theorem which provides 
a weak limit for the sequences of diffusion scaled virtual waiting time and 
customer waiting time processes in the Halfin-Whitt regime. Note that as a 
byproduct, this limit implies that waiting times in the Halfin-Whitt regime 
are of order N~ 1 / 2 and thus decrease as the number of servers become large. 
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Furthermore, we also note that as expounded upon further below, the limit 
we obtain is similar in form to that informally obtained by Mandelbaum 
and Momcilovic in [16] for the diffusion scaled virtual waiting time process. 
We then have the following. 

Proposition 5.3. If A N (0) = F-a.s. for each N>1, and the residual 
service time distribution Fq = F e and Qq =^ Qo as N ^ oo, then V N =>■ V 

as N — ► oo and V N =^V as N — > oo, where V is given by the unique solution 
to the integral equation 

(5.34) V(t) = ^M Q (t)+Qj(t)-f3F e (t)+ jW(t-s)dF(s)y, t>0. 

In [16] , in the case of renewal arrivals, the diffusion scaled limiting station- 
ary virtual waiting time process was conjectured to be expressed in terms 
of the supremum over an infinite weighted full K-&ry tree 

(5.35) ^oo(*)= sup (W T ) + , tel. 

TcF[t] 

Furthermore, it was shown in Lemma 10 of [16] that the process = 
{Voo (t),t > 0} defined by (5.35) satisfies the stochastic integral equation 

(5.36) V 0O (t) = (x(t)-p + J™V(t-u)dF(u)^ + , t€l, 

where X = {X(t),t > 0} is a stationary Gaussian process whose covariance 
function may be explicitly calculated. 

We now show informally by taking the limit as t approaches oo on both 
sides of (5.34) that (5.36) may actually be viewed as the stationary version 
of the limiting diffusion scaled virtual waiting time process. First, note that 
by the definition of Mq in (5.15), we have that Mcj{t) — > P t — ► oo. 

Next, since F e is a distribution function, it follows that (3F e (t) — ► f3 P-a.s. as 
t — ► cxo. Thus, for t large, we have from (5.34) that 

(5.37) V(t + s) » ^Q 7 (t + s)-P + J* +S V(t + s- u) dF{u) 

for s > 0, where the ~ sign is meant to mean approximately equal. One may 
next check that for t large the process {Qi(t + s),s > 0} is approximately 
equal in law to that of X in (5.37). Finally, for t large, the integral on the 
right-hand side of (5.37) may be taken to be an interval over the entire 
nonnegative portion of the real line. Thus, setting Vt = {V(t + s), s > 0}, we 
obtain from (5.37) and the preceding discussion that 

(5.38) Vt(s)f* (x(8)-0 + J™V t (s-u)dF(u)) , s>0, 
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which is the similar to (5.38). As t approaches oo, the approximation in 
(5.38) becomes more precise and indeed a completely rigorous argument of 
the discussion above may be given but we omit the details here. 

In order to prove Proposition 5.3, we must first provide an intermediary 
result for the diffusion scaled number of customers waiting to be served. 
Note that since the system is operating under a nonidling policy, the total 
number of customers waiting to be served at time t is given by the quantity 
(Q N (t) - N) + . We also define 

<^ W = «S^, ( >o, 

to be the diffusion scaled number of customers waiting to be served at time 
t and set Q N >+ = {N~ 1 / 2 (Q N (t) - N)+,t > 0} to be the diffusion scaled 
number of customers waiting to be served process. Note also the relationship 
Q N,+ (t) = (Q N (t)) + which will be taken advantage of in the following result. 

Proposition 5.4. If the residual service time distribution Fq, = F e and 
Qq => Qq as N — > oo, then we have the joint convergence {Q N ,Q N,+ ) =>• 
(Qf,Qf) in (D 2 [0,oo),V 2 ) asN^oo. 

Proof. Define the function f:(D [0,oo),djj h-> (D 2 [0,00),^) by 
f(x±) = (xi,xf) for x\ G D[0,oo), where xf = (max{0, xi(t)}, t > 0). We 
now claim that the function / : (D[0, 00), dj x ) \—> (D [0, 00), dj ) is continu- 
ous. Assume that x™ — > x\ in dj L . We then have that 

^ (/(*?), /(*!)) = 4(K,X^ + ),(X 1 ,X+)) 

= max{dj 1 (xi,x 1 ),dj 1 (x 1 l' + ,xf)} 
< dj^^i) 
^0 as n —> 00, 

and thus the claim is proven. The proof now follows by the representa- 
tion (Q N ,Q N ' + ) = f(Q N ), the Continuous Mapping theorem [20] and The- 
orem 5.1 above. □ 

Using Lemma A. 10 in the Appendix, we may now prove the proposition 
above. 

Proof of Proposition 5.3. By Proposition 5.4, Q N ' + Q + as N — ► 
00 and by assumption we have that £ as N — > 00. Furthermore, by 

(5.1) and the heavy traffic condition (5.3), p N — > 1 as N — > 00. Thus, by 
Lemma A. 10 in the Appendix, V N =4> V = Q + as N — > 00, which by the 
representation (5.33), completes the proof. □ 
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5.5. An alternative representation. The representation of the limiting 
diffusion scaled queue length process given by (5.33) provides a convenient 
expression for Qp in terms of a corresponding infinite server queue limit, 
Qj. However, it is not evident that the limiting process of (5.33) is equiv- 
alent to the diffusion limit of Theorem 2 of Halfin and Whitt [8] for the 
specific case of exponentially distributed service times. The following corol- 
lary provides an alternative representation of the limit of (5.33) which may 
be used to rigorously verify this equivalency. Let M = {M(t),t > 0} be the 
renewal function associated with the pure renewal process with interarrival 
distribution given by the service time distribution F. Recall that for t > 0, 
M(t) is by definition equal to the expected number of renewals by time t. 
Furthermore, by Exercise 3.4 of [19], M is given by the unique solution to 
the renewal equation 

(5.39) M{t)=F{t)+ f* M(t-u)dF(u) for t > 0. 

Jo 

Let us also set 

(5.40) C(t) = M Q (t) + Q I (t), t>0, 
and C — {C(^)>£ > 0}- We then have the following result. 

Corollary 5.2. The limiting process, Qf, of Theorem 5.1 may be 
equivalently expressed as the unique strong solution to 

(5.41) Q M (t) = C(t) + / ((t - u) dM{u) -(it- f Q~ M {t - u) dM{u) 

Jo Jo 

for t>0, where Qjj(t) = min(QM (t), 0). 

Proof. Let F = {F(t),t > 0} be a distribution function and r = {r(t),t > 
0} be an unknown function satisfying the integral equation of renewal type, 

(5.42) r(t)=H(t)+ f r{t)dF(t-u) for t > 

J o 

for some H = {H(t),t > 0}. If H is a locally bounded function, then (5.42) 
has a unique locally bounded solution [11], which is given by 

(5.43) r(t) = H(t)+ f H(t-u)dM(u), 

Jo 

where M = {M(t),t > 0} is the solution to the renewal equation (5.39). 

By the definition of £ in (5.40) and the representation (5.33), the limiting 
process of Theorem 5.1 may be written as 

Q F (t)=((t)-f3F e (t)+ f Q+(s)dF(t-s) fort>0. 

Jo 
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Next, since Q F = Q F + Q F , we have 

Q+(t) = ((t) - pF e (t) - Q F (t)~ - f Q + F (s) dF(t - s). 

Jo 

Furthermore, it follows that £ — (5F e + Qp is almost surely a locally bounded 
function since it is almost surely an element of D[0,oo). It therefore follows 
from (5.42) and (5.43) that 

Qp{t) = C(i) - 0F e (t) - Q F (t) + /* ((t - u) dM(u) 

Jo 



P [ F e {t-u)dM(u) - [ Qp(t-u)dM(u), 
Jo Jo 



or, equivalently, 



Q F {t) = C(t) + f ((t - u) dM{u) 
Jo 



(5.44) -p(F e {t)+ J* F e {t-s)dM{s)j 

Q F (t-u) dM(u). 



However, since 

F e (t)+ [ F e (t- s)dM(s)=t, t>0, 
Jo 

if follows by (5.44) that 

(5.45) Q F (t)=((t)+ [ ((t-u)dM(u)-pt- f Q F (t — u) dM(u), 

Jo Jo 

which completes the proof. □ 

Note that Corollary 5.2 also implies the convergence Q N =>■ Qm as 
oo, where Qm is the stochastic process given by the unique strong solution 
to (5.41). The proof of this result is trivial and essentially proceeds in two 
stages. First, one may use Theorem 5.1 to show the weak convergence Q N =>• 
Q F as N — > oo and then use Corollary 2 to show the equivalency in law 
between Q F and Qm- In a sequel [18] to this paper, we provide a more direct 
proof of the convergence of Q N to Qm- This follows along more traditional 
line of conventional heavy-traffic proofs in where the queue length process is 
modeled by a conservation of flow as the difference between the number of 
arrivals and the number of departures. The integral term on the right-hand 
side of (5.41) then turns out to representative of the idle time processes of 
the servers in the system. 



THE G/GI/N QUEUE IN THE HALFIN-WHITT REGIME 



31 



As noted above, in the case of the GI/M/N queue, Corollary 5.2 may 
be used to obtain the original diffusion limit result provided by Halfin and 
Whitt [6]. This may be seen by first noting that for exponentially distributed 
service times, the renewal function M in (5.41) is the renewal function for a 
rate 1 Poisson process, which is simply given by M(t) = t. Thus, the limiting 
process of Corollary 5.2 may be written as 

(5.46) Q M it) = C(t) + f C(s) ds-pt- [ Q- M {s) ds, t > 0. 

J o Jo 

Furthermore, using (5.40), (5.15) and (5.17), extensive covariance calcula- 
tions show that 

B(t) = C(t) + / C(«) ds, *>0, 
J o 

is a Brownian motion with infinitesimal variance 1 + a 2 , where a 2 is the 
variance of the interarrival times. Therefore, the process (5.46) is a diffusion 
with infinitesimal drift m(x) = —(3 for x > and m{x) = —x — (3 for x < 
and infinitesimal variance 1 + a 2 , which is in agreement with Theorem 3 of 
Halfin and Whitt [6]. 

6. Conclusion. In this paper, we have studied the G/GI/N queue in 
the Halfin- Whitt regime. In our first main result, we obtained a first-order 
approximation to the queue length process. This approximation turned out 
to be the solution to a nonlinear convolution equation. Next, after centering 
the queue length process by its deterministic fluid limit and scaling by an 
appropriate constant, we obtained a second-order stochastic approximation 
as well. Our limiting stochastic process is nonlinear, stochastic convolution 
equation which is driven by a Gaussian process and includes a drift term 
which incorporates a time lag. In the case of exponentially distributed service 
times, it can be shown that this process is equivalent to the diffusion process 
obtained by Halfin and Whitt [6]. 

In the sequel to this paper [18], we provide a direct approach to the proof 
of Corollary 5.2. This is based off of a conservation of flow equation where 
we write the queue length process as the difference between the number of 
arrivals and the number of departures. In this case, central limit theorem 
type results for sums of i.i.d. renewal process will have to be invoked. 

In the future, it would be nice to have a better understanding of the limit- 
ing process we have obtained. Ideally, one would like to solve for its limiting 
distribution. Unfortunately, this in general appears to be a difficult prob- 
lem. Therefore, if analytical solutions cannot be found, efficient numerical 
procedures might perhaps be developed. Simulation studies could also be 
conducted to test the accuracy of the proposed approximations relative to 
their actual values. This would be especially interesting when the system is 
close to being in the Halfin-Whitt regime. 
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APPENDIX 

In the appendix, we provide the proofs of Propositions 3.1, 4.2 and 5.1 
and Lemmas A. 9 and A. 10. We begin with the proof of Proposition 3.1. 

Proof of Proposition 3.1. Suppose first that B is concentrated on 
the point c> 0. In this case, it is clear that the solution to (3.1) satisfies the 
recursion 

(A.l) z(t) = x(t), 0<t<c, 

and 

z(t) = x(t) + (z(t - c) + a) + , t>c, 

in which case it is clearly unique. Furthermore, defining <f B : Z)[0,oo) i— >• 
D[0, oo) to be the solution to this recursion, it follows that 

H^Kxi) - ip a B (x 2 )\\ t = \\xi - X 2 \\t 

for < t < c. Now suppose that for some integer k, we have 

(A.2) Wb(xi) ~ <P%fa)\\t < - x 2 \\ t 

for {k — l)c <t<kc. It then follows that for k <t < (k+ l)c, 

\\<p%(xi) ~ <P%( x 2)\\t < \\xi - x 2 \\ t + \\(p%(xi) - <p B (x 2 )\\t-c 

< \\x\ - x 2 \\ t + k\\xi - x 2 \\ t 

= (k+ l)\\xi - x 2 \\ t . 

By induction, this implies that the relationship (A.2) must hold for all t, 
which show that (p B is Lipschitz continuous if B is concentrated on a single 
point. The proof of measur ability of ip B for the case of B concentrated at a 
single point will be included below. 

Suppose now that there exists a 6 > such that B(y + 5) — B(y) < e 
for some < e < 1 for all y > 0. Such a 5 will always exist so long as B 
is not concentrated on a single point. We now provide proofs of existence, 
uniqueness and Lipschitz continuity for this case. 

Existence: We use the method of successive approximations. Let uo = 
and recursively define 

(A.3) u n+ i{t) =x{t) + / (un(t-s) +a) + dB(s), t > 0, 

Jo 

for n > 1 and note that 
u n+ i(t) - u n (t) 



(A.4) 



o 



((unit -s)+ a) + - (n n _i(t - s) + a) + ) dB(s), t > 0. 
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We now show by induction that for each integer 1 < k < [5 _1 T], 
(A. 5) \\u n+ i -UnWjS < j j n j e n \\x\\ T for j = 1, . . . ,k, 

for n > 1. For the base case k = 1, observe by (A. 4) that 

\\Un+l -Un\\s < -B(<5)lk„ -« re _i||(5 < e\\u n -U n -i\\s, 

and so, since 

(A. 6) ||tti - u \\ s = \\xx - 0\\ s < \\xi\\t, 

we have the relationship 

(A. 7) ||n n+ i - u n \\ s < £ n |M|T < ne n ||x|| T 

for n > 1. We now proceed with the induction step. Assume that (A. 5) holds 
for some k and we will now show that it holds for (k + 1). Note that by (A. 4) 
and the induction hypothesis (A. 5), 

(A. 8) ||«n+l — «n||(fc+l)5 

k 

< ^2 e\\u n — u n -i\\js + e\\u n — u n -i||(fc+i)5 

3=1 
k 

<^2^j j (n- lye^eWxWr + e\\u n - u n _i|| (fe+1)(5 
j'=i 

(A.9) < A; fc+ Ve n ||x|| T + e|K - «n-i||(fc+i)i- 

Furthermore, since as in (A. 6), 

|| - uo\\is < IMIt 
for all I = 1, . . . , [~<5 _1 T] , it follows by repeated iteration of (A.9) that 

|K+i -u n \\ {k+1)s <k k+l (^2i k ^je n \\x\\ T 

<k k+1 (n k+1 + l)e n \\x\\ T 

< (k + l) k+1 n k+1 e n \\x\\ T , 

and so the induction hypothesis has been proved. 
Thus, since 

oo oo 

\\Un+l — Un\\r < \\ U n+l ~ u n\\ \S- X T\S 
n=l 

oo 

K^lS-^-'V^e^xWr 

n=l 

< OO, 



n=l n=l 

oo 
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it follows that {u n } is a Cauchy sequence. Furthermore, since the space 
D[0,oo) is a Banach space under the supremum metric u, there exists a 
limit point u* of {u n }. Taking limits on both sides of (A. 3), we now see that 
u* is a solution to (3.1), which completes the proof of existence for the case 
of nondegenerate distributions. 

Uniqueness: Suppose that u and v both satisfy (3.1) and let 

A{t) = u(t) - v(t) = j\(u{t -s) + a) + - (v(t -s) + a) + ) dB(s), t > 0. 



o 

We then have for < t < 5, that 

I A(t)| < / \(u(t -s) + a) + - (v(t -s) + a) + \ dB(s) < e\\A\\ 5 , 
Jo 

which implies that A(t) = on [0, 5]. Next, for 5 < t < 25, we have that 

|A(t)| <e||A||a +e||A||26 = e||A|| 2a , 

which implies that A(t) = on [5, 2<5]. Iterating the above argument until 
we reach T completes the proof. 

Lipschitz continuity: Note that for < t < 5, we have 

\\<p B ( x 2) ~ Vb( x i)\\s < \\x2 ~ xi\\s + e\\ip%{x 2 ) - ip%{xi)\\ s , 
which implies that 

\\tp a B (x 2 ) - ip B ( x i)\\6 < (1 - ^)~ 1 lk2 - ^ills- 
Next, for 5 < t < 25, we have 

\\<P%(X2) - (p%(xi)\\2S 

< \\x 2 - xi|| 2< 5 + e\\ip%{x 2 ) - if%(x 1 )\\ 5 + e\\(p%{x 2 ) - ip%(xi)\\ 2S 

< ^^^ Iki ~ x 2 \\ 2 s + e\\f a B {x 2 ) - (f%(xi)\\ 2S , 
which implies that 

WfB^) ~ ^|(^i)||25 < n 1 , 2 \\xi - x 2 \\ 2S . 

Iterating the above argument for k = [(J" 1 ^ — 2 more time intervals com- 
pletes the proof. 

Finally, we provide a proof of measurability of (p B for the case of a general 

B. 

Measurability: We begin by defining the function ^f B : D[0, oo) — ► D : [0, oo) 

by 

y%(u)(t) = f (u(t -s) + a) + alB{s), t > 0. 
Jo 
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We now show that is measurable with respect to the Borel cr-field T> 
generated by the Skorohod J\ topology. Note that since V is equal to the 
Kolmogorov cr-field, which is generated by the finite-dimensional cylinder 
sets, it is sufficient to check that for each n > 1 and Ai,A2, ■ ■ ■ , A n G B(R), 

{u G £>[0,oc) : (*i), . . . , ¥£(«)(*»)) G (A\ , . . . , A n )} G V 

for < t\ < t2 < ■ ■ ■ < t n . However, since a-algebras are closed under finite 
intersections, it is sufficient to check that for each t > 0,^/g(-)(t) is measur- 
able. In order to show this, we first decompose B into its continuous and 
discrete parts so that 

B(t) = B c (t) + B d (t), t>0, 

where we write 

oo 

(A.10) B d (t) = J2c n S iPn) (t) 

n=l 

for the discrete part of B. We then show that both and ^?% d are mea- 
surable functions and so, since the sum of two measurable functions from 
(D,T>) to (D,T>) is measurable, and = + *$>% d , we have the desired 
measurability of ^>%. 

We begin with the proof of measurability for for which it will be 
sufficient to show that for each t > 0, (-)(t) is continuous when viewed 
as a function from (D[0, oo), dj 1 ) to (M, | • |). Let u n — ► u under the metric 
dj 1 . This then implies that u n (t) — > u(t) for all but a countable number of 
t (see, for instance, page 247 of [1]). Furthermore, the measure defined by 
B c assigns measure to all countable sets. Thus, since for each t > 0, the 
sequence {sup < s < f \u n (s)\,n > 1} is bounded, it follows by Theorem 3 of [4] 
that 

(A.ll) |*| c (u n )(t)-*| c (u)(t)| 
ft 

= / {{u n {t- s) + a) + -{u{t- s) + a) + )dB{s) 
Jo 

< [ \u n {t- s) -u(s)\dB(s) 
Jo 

(A. 12) ^0 asn^oo. 

This completes the proof of the measurability of ^P"^ . 
Now consider ^% d - It is clear from (A. 10) that 

oo 

n d (u)(t) = j2? k (u)(t), t>o, 
k=i 
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where 

T k (u)(t) =c k l{t >Pk}(u(t-p k ) +a) 4 
For each n > 1, define 

n 

= £T^)(i), t>0. 
fc=l 

We then have that for each u£ D[0, oo) and £ > 0, 

sup \n^u)( S )-n d (u)(s)\ 

0<s<t d 



■ sup 

0<s<t 



£ Cfc 1 ! 5 ^ Pk}(u(s - p k ) + a) 



< sup \u(s) + a| V c fc 
— > as n —> oo, 

and so it follows that V&jj (u) is the pointwise limit in (D[0, oo), u) of ^^"(u) 
as n-> oo. Thus, if each ^fg n (u) is measurable, it will follow that ^% is 
measurable as well. However, in order to show that \]/^™ is measurable, it 
will suffice to show that each is measurable since the sum of a finite 
number of measurable functions is measurable. The fact that T*. is measur- 
able may been seen by noting that Tfc is first the translation of the function 
u by a constant pk and then a multiplication by a constant Both of 
these functions are easily seen to be measurable functions and so being 
the composition of two measurable functions, is measurable as well. This 
completes the proof of the measurability of 'f'g . 

Now define the map E% : (D[0, oo),X>) i-> (L>[6, oo), £>) by 

3£(u)(t) =*(*)+*&(«)(*), t>0. 

It is clear that E'g is measurable since is measurable. Furthermore, 
from the existence portion of the arguments above, it follows that for each 
x e D[0,oo), 



( ^( x ) = i™ H S n (°) 



where H^ n (x) = S^™" 1 o is the n-fold composition of with itself 
and the limit is taken with respect to the metric of uniform convergence 
over bounded intervals, u. Thus, since the composition of two measurable 
functions is measurable, it follows that is measurable for each n. But this 
then implies that <pg, being the pointwise limit of a sequence of measurable 
functions, is measurable as well, and so the proof is now complete. □ 
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The next portion of the Appendix is devoted to the proofs of Proposi- 
tions 4.2 and 5.1. Our proof of Proposition 4.2 closely parallels the proofs of 
Lemmas 3.4-3.8 of [14]. In order to begin, we must first set up the following 
notation. Let A N (t) be equal to the number of customers in the iVth system 
who entered service after time 0— but before or at time t. We then define 
the two parameter process 

A N (t) 

(A.13) V N (t,x)= ^2 (l{r]i<x}-F(x)), t>0,x>0, 

i=l 

where we recall the definition in Section 2 of rji as the service time of the 
ith. customer to arrive to the system after time 0—. Note that by setting 

[Nt] 

U N (t,x) = ^2(l{F(in)<x}-x), t>0,0<x< 1, 
i=i 

we have 

(A.14) V N (t,x) = U N (A N (t),F(x)), 

where 

(A.15) A N (t) = ^, t>0. 

It then follows from the definition of in (2.5) that 

(A.16) M$ f (t)= /' [* l{s + x<t}dV N (s,x), 

Jo Jo 

where the integrals above are taken over the closed intervals [0,t]. We now 
decompose in two processes, G N and H N . Let 

(A.17) L N (t, x) = < ~ I -S^-) ) ' *>°^>°> 

where F(y—) = \im x - >y F(x). 

By (A.13) and (A.17), we have that 

(A.18) V N (t, x) = - jT f^-) dF{v) + LN{t > XY 

Therefore, by (A.16) and (A.18), we have 

(A. 19) M?(t) = G N {t) + H N (t), 

where 

G N {t) = -f V y-^ X - ) dF{xl t>0, 
Jo l-F(x-) 
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and 

ft rt 



(A.20) H N (t)= [ [ l{s + x<t}dL N (s,x), t>0. 

Jo Jo 

We set G N = {G N (t),t> 0} and H N = {H N (t),t> 0} and note that (A. 19) 
is the desired decomposition of M% ■ It will be useful in proving several 
results related to such as tightness and weak convergence. 
Now, for each k > 1, let 

AN M Ak f , r*A(t-ff)+ dF{u) 



.0+ l-F(u-) 
for t > 0, where 

ff = inf{f>0:i Ar (i)>z} 

is the time at which the ith customer to enter service after time 0— begins 
being served. We also set HP = {Hjp(t),t > 0}. Furthermore, we define the 
filtration H N = (Hf, t > 0) by 

Hf = a{Q$} V a{fji, i > 1} V cr{e*,* > 1} 

V a{l{ m = 0}, l{ m <s-r l N },s<t,i = l,.. . , A N (t)} 

\/ a{A N {s),s<t}\/M, 

where £j is as defined in (2.1) of Section 2 and M is the P completion of 
T . It easy to see that satisfies the usual conditions and is actually a 
filtration. 

The following lemma is similar to Lemma 3.5 of [14]. Consequently, the 
proof that follows is a straightforward adaptation of that found in [14] . 

Lemma A.l. The process is an H N -square-integrable martingale 
with predictable quadratic variation process 

Proof. We first decompose by writing 

H»(t)=j:H N >\t), 

1=1 

where 

(A. 21) fl ^ ) . H o<, i < i -ff}-r < '" , ' ,+ r ^ 1 . 

Jo+ 1 - F[u-) 

As in [14], the proof now proceeds in three parts. They are: 
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1. For each i > 1, the process H N ' 1 = (H N,l (t),t > 0) is an H^-square- 
integrable martingale. 

2. The predictable quadratic covariation process of H N,t is given by 

(A, 2) ( ^ )(t) .r<«- f '» + 7T i^L i ^ M . 



A+ (1 - F(u-jf 

3. The martingales H N,% and i?^'-?' are orthogonal for i ^ j. 

These three statements are then sufficient to imply the conclusion of the 
lemma. We begin with the proof of part 1. 

First, note that H N ' 1 is H^-adapted and, furthermore, we have that 

sup^F^i)) 2 <oo. 

t>0 

We now prove the martingale property for H N ' 1 by showing that for s < t, 

(A.23) l{<ff > s}E[H N > l (t)\H?} = 

and 

(A.24) l{ff < syElH^it^Hf] = H^is). 

We begin with (A.23). First, note that is an H^-stopping time since 
a(A (s), s < t) C for each t > and so we may define the cr-field 7i^ N . 

i 

Furthermore, 

l{ff > s}E[H N >\t)\H?] = l{ff > S }£[£(iT^)l^)l^f ]. 
In order to prove (A.23), we now show that 
(A.25) E(H N ' i (t)\H N N )=0. 

i 

This follows informally since on the event {rji > 0}, we have 

(A.26) E(H^(t)\H» N ) = lfo > 0} ^|^jP = 0, 

P(Vi > 0) 

where the last equality is by (A.21) and the independence of r)i and rf . 
In order to rigorously to prove the first equality in (A.26), we make use of 
Lemma 3.6 of [14]. 

Specifically, we show that 

(A.27) H% n {7]i > 0} C (a{Q$} V a{fj i} i > 1} 

i 

(A.28) V a{S r , r > 1, Vp ,p > l,p + i} V a{f^}\fj\f) 

n{rn>0}. 
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Note that it is enough to check (A. 27) for sets which generate 7^^. However, 
by the definition of rtf^ , it is not difficult to see that 
H% = a{Q$} V a{fji,i > 1} V <r{£ r ,r > 1} 

i 

(A.29) V a{r*, l{rj r = 0}, 1{0 < r] r < s A ff - f*}, 

s>0,r=l,...,A N {t l N )}vAf 

(use, for example, the argument of Bremaud [3]). Then, for I = + . . . ,m = 
1, 2, . . . , n = 1, 2, . . . , s\, S2, ■ • ■ , Si > and Borel sets A, B\, . . . , B m , C±, . . . , 
C n , D±, . . . , Ei, . . . , Ei and Fi,...,Fi, we have, since A N (f^) > I > i, then 
= ?i , r = i + 1, . . . , I, that 

{Qo £ A}n g S r }J n f f] e C r }^ n {^(ff) > 1} 

n f g D r }j n f f^K = 0} e ^ 

n ff| 1{0 < r? r < s r A rf - f r N } G F r ^J n {r/, > 0} 

(A.30) = {Qo £ A}n ^P) {?> g s r }j n f f] {& G Cr}^) 

n f n (*? = f r N }) n f flV g A.}") n ff){^ g A}) 



\r=i+l / \r=l 

\r=l,r^j / 



n 



(f) 1{0 <7l r <S r AT? -t?}€F r \ H {l/i > 0}, 



\r=l 

when 0£j?j,0£F r ,i<r<I, and the left-hand side is otherwise. We show 
that the event on the right-hand side of (A.30) is in {&{Qo} V a{f}i,i > 
1} V cr{£ r ,r > l,rjp,P > hP + i} v V AT) n > 0}. It is enough to 

prove that this holds for the event 

fl {r i /V = f r Af }n{r ?4 >0}. 
r=i+l 

First, note that for i + 1, there exists a Borel function such that 
rili = r i+ i V ((ff + A hf +1 (Q%,fn,l> l,£ r ,r > l, Vp ,p > l.p^i)). 
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The random variable hK. 1 (QQ,iji,l > l,£ r ,r > l,rj p ,p > l,p 7^ i) is either 
equal to if a server is idle in the system after the arrival of customer 
i or, if not, the time of the next departure from the queue after the arrival 
of customer i not including customer i. Since, 

{f!li = r t N } = {rili<r t N }n{ Vt = 0} 

utt;i) ll I>U r ,'->l,W>l 1 p^)<rf} 1 

we have that 

{t? = f r N } n {vi > 0} 

(A.31) = {ril, < ff } n {hfi^., r>l iVpi p> l,p 7^) < ff } 

n{m>o}. 

A similar argument shows that for r = i + 2, . . . , I 

{*f = *f}nfa>0} 

(A 32) 

= {r r N < ff } n r > 1, r, p ,p > l,p ^ i) < ff } n > 0}, 

where T^Y is also a Borel function and fo^ {£r,r > l,r]p,p > l,p / 2) is the 
time of the (r — i)th departure from the queue after the arrival of customer 
i not taking into account customer i. By (A.31) and (A. 32), 

{rf =f r iV }n{r ?i >0} 

r=i+l 

= fl K w <^}n H K Ar (^,r>i,7 ?p ,p>i, P /i) = f/ v } 

r=i+l T=i+1 

n > 0}, 

which yields (A. 27). By Lemma 3.6 of [14], (A. 27) implies the first equality 
in (A. 26) which show that (A. 25) holds and so (A. 23) is proved. 
We now proceed to show that (A. 24) holds. We have 

l{*?<8}E[H N *{t)\H»\ 

= l{Vi < s - t?}E[H N *{t)\H^\ + l{ Vi > s - ff > 0}E[H N >*(t)\H?}. 

However, since both l{r)i < s — ff} and l{r/,, > s — ff} are both 
measurable, and by (A. 21) we have that 

l{77i<s-ff}tf^(i) 

= l{0<r ?l < S -f/ v } 

r%A( s -ff)+ dF ( u ^ 



Hvi <s-f, N } r 

Jo- 



1 - F(u- 
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where the latter is Tif -measurable, it follows that 
l{f t N <s}E[H N >\t)\H?] 
= 1{0 < Tji < s - ff } 

(A 33) 

+ l{r, i> s-T l N >0}E[H N > i (t)\H»}. 

We now proceed to evaluate the quantity l{r]i > s — ff > 0}E[H > l (t)\Ttf]. 
First observe that on the event that customer i has not completed service 
by time s, mathematically, the event {rji > s — ff > 0}, we have that rji is 
independent of the process A N up to time s which keeps track of the number 
of customers who have entered service by time s. Also, since rji is independent 
of rji for I i, we conclude from the definition of TLf and (A. 21) that, on the 
event {rji > s — ff > 0},H N,,l (t) is dependent upon Tif only though rji and 
ff. To put it more accurately, let A N (u),u > 0, be the number of arrivals 
to the servers up until time u that would have occurred if the customer with 
service time rji remained in service forever. Then, A N (u) is a Borel function 
of $, r , r > Ij^piP > l,p 7^ i, on the one hand, and coincides with A N (u) for 
u < s on the event {ff + rji > s}, on the other hand. In analogy with (A. 27), 
this yields by the definition of Tif, 

n {rji > s - ff > 0} 

(A.34) c (a{t r ,r>l,rj p ,p>l, P ^i}Va{f?}vN) 

n {rji > s - ff > 0}. 

Now noting that \{rji > s — ff > 0} is Ttf -measurable and applying Lemma 
3.6 of [14], it then follows that 

l{Vi>s-f i N >0}E[H N ' i (t)\H»] 



l{ru > s - ff > 0} 



E[l{ m >s-ff}H^{t)\ff] 
1 P(rii>s-f?\fn 



where 0/0 = 0. Now evaluating the right-hand side of the above using (A. 21), 
it follows 

l{T H >8-T?>0}E[H N > i (t)\H?] 

dF(u) 
l-F(u-)' 

which, together with (A. 33), implies (A. 24). We now have that (A. 23) and 
(A. 24) have been proved and so the martingale property of H N ' 1 has been 
proved. 



-l{ m >s-ff >0} /' 
Jo 
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The proof of part 2 follows identically to the proof of part 2 of Lemma 
3.5 of [14]. In particular, since the second term on the right-hand side of 
(A. 21) is H^-predictable, the H^-predictable measure of the jumps of the 
process (1{0 < rji <t — f^},t > 0) is (see Liptser and Shiryaev [15], Jacod 
and Shiryaev [9]) 

^([0, T],A) = {le A} f l{ff < u < th + rf h d ^~fl , 

Jo l-F((u-r/ v )-) 

and so the predictable quadratic- variation process of H N > 1 is (see, e.g., 
Liptser and Shiryaev [15], Problem 11, Chapter 4, Section 1) 

(H N ' i ){t)= f [ x 2 v N ' i {du,dx)- Y ( f xv N > i {{u},dx) 
Jo Jr 0<u <A Jr 



f l{f l N <u<r li + T l N } 
Jo 



dF{u-T») 
l_F((„-*f)_) 



%v(t-ff)+ dF(u) y, ( AF(u) 



o l-F(u-) ^ „ \1-F(u-) 

where the sum is over all of the jumps. Since the above is equal to the 
right-hand side of (A. 22), this then completes the proof of part 2. 

We now demonstrate step 3 by proving the martingale property for H N ' l H N '^ 
in a similar to manner to the proof of the martingale property for H ,i . 
Specifically, for s <t,j < i, we prove that 

(A.35) > s}E[H N ' i (t)H N ' j {t)\n^] = 

and 

(A.36) l{ff < s}E[H N > i (t)H N >i(t)\Hf]=H N > i (t)H N >i(t). 
For (A.35), we have 

(A.37) l{ff > s}E[H N ' i {t)H N >i(t)\H^} 

(A.38) = l{ff > s}E[E[H N ' t {t)H N ^ (t)\H^ N ]\n^}. 

i 

However, since 

E{H N ^ l {t)H N ^{t)\H^ N } 

i 

(A.39) = l{ Vj <ff- t?}E[H N \t)H N >i{t)\H*} 

+ l{ Vj > ff - f?}E[H N >\t)H N >J(t)\H? N ], 
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and < ff -ff } and l{ Vj < ff-ff}H N ^(t) = < ff -ff }H N >i(t A 
ff ) are -measurable [use (A. 29)], it follows that 



l{ m <ff -ff}E[H N \t)H^{t)\Hf r 



£[1^ < ff - ff }2f"''(t)F^(t)|ff#] 
< ff " t?}H N >'(t)E[H*V{t)\H»- 



j 

-JVj, 

and so, since if-"'* is a square-integrable martingale, by Doob's stopping 
theorem ([9], 1.1.19, 1.1.42), E[H N ^{t)\H%] = H N ^{ff ) = and thus, the 

i 

first term on the right-hand side of (A. 39) is 0. 

Consider now the second term. On the event {r/j > ff — ff}, we have 
that customer j finishes service after customer % arrives and so customer j's 
service time has no no effect on ff , the time at which customer i enters 
service. Thus, r]j and ff are independent on the event {r]j > ff — ff}- 
To put it more accurately, there exists a random variable ff which is a 
Borel function of £ r , r > l,r] p ,p> l,p ^ i,p ^ j, such that > ff — ff} = 

i 7 !] > h ~~ f } anc ^ = on either event. One may view ff as the time 
at which customer i would enters service if customer j's service time were 
infinitely long. Thus, applying Lemma 3.6 of [14] and using the fact that rji 
and r]j are independent of ff and ff , we have that 



l{r lj >ff -ff}E[H^(t)H^(t)\H 



■N 



■ g[lfa > ff - ff }i^(t)i^)|ff ,ff ] 



l{^>ff-ff} ; 



P(Vj>ff-rf\ff,r 3 t 

where H N ' 1 denotes H N,t with ff substituted for ff . Furthermore, since rji 
is independent of ff ,f]j and ff , we obtain that 

E[l{ Vj > ff - ff}H^(t)H^(t)\ff,ff] 

= E[1{ V] > ff - ff}H^(t)\ff,ff]E[H^(t)\ff], 

where the last multiplier on the right-hand side is equal to by the definition 
of H N,i and the fact that r\i is independent of ff . Thus, the right-hand side 
of (A.39) is 0, and so E[H N ' i (t)H N >3(t)\H* r i T ] = so that (A.35) is proved. 

i 

In order to prove (A. 36), we proceed similarly to (A. 24) and so some of 
the details are omitted. First, note that 

l{ff < s}E[H N ' i (t)H N ' j {t)\H^] 

= 1{th < s - ff}l{ Vj < s - ff}E[H N >\t)H N >i{t)\Hf] 
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+ l{ Vl >s-f l N > 0}l{ Vj < s - fj*}E[H N '\t)H^{t)\H^) 

(A.40) 

+ l{ra > s - ff > 0}l{ Vj < s - fj*}E[H N \t)H N ^(t)\H^} 
+ l{r]i > s - ff > 0}1{^- > s - fj* > 0} 
x E[H N ^{t)H N ^{t)\H^ ] 

and, further, 

l{r?i < a - ff }1{^- < a - fj*}E[H N >\t)H N ^t)\H?] 

= l{m<S-T l N }l{ Vj <S-t?} 

(A.41) 

x E[1{th < s - r?}H N >\t)l{ m < s - fj*}H^(t)\H^\ 

= 1{th < s - ff < s - fj*}H N '\t)H N ^(t), 

l{m < s - Tfyifa > s - fj* > 0}E[H N >\t)H N J(t)\H»] 

(A.42) = 1^77^ < s - ff }fT JV '*(s)l{^ >s-fj*> 0}E[H N j(t)\H^} 

= Hvi < s - f?}H N >\s)l{ m >8-r?> 0}H N >i( S ), 

1{th >s-f t N > 0}l{ Vj < s - fj*}E[H N >\t)H N ^t)\H^] 

(A.43) = l{ Vj < s - fj*0}H N '^s)l{ m > s - ff > 

= 1{77j < s - ffO}H N *(8)l{m > s - ff > O}*^*), 

where in (A.42) and (A.43) we use the martingale property of H N,t and 
H N,j 

Consider now the last term on the right of (A.40). Since {s — ff > 0, rjj > 
s — fj*} C {rjj > ff — f^}, it follows as above that {s — ff > 0,r]j > s — 
fj*} = {s — ff > 0, r]j > s — fj*} and ff = ff on either event. Hence, 

l{ Vi >s-ff*> 0}l{ Vj >s-fj*> 0}E[H N ' i (t)H N ^(t)\H^} 

= i{m >s-f(*> o}i{ Vj > 8 -fj f > o}E[H N ' i (t)H N ^(t)\n^ 

where r\i and r\j are independent of ff and fj*. Also, similar to (A. 27) and 
(A.34), 

H^n{m>s-fi T }n{r ti >a-rf} 

C W?r,r> l,v P ,P > 1,P^ hV^ 3} V <r{ff ,ff } V AT) 

n > s - ff } n > s - fj*}, 
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and so by Lemma 3.6 of [14], 

1{th > s - ff > 0}l{»fc > a - rf > 0}E[H N ' l (t)H N 'i{t)\H^} 

= l{ Vl > s - ff > 0}l{ Vj > s - ff > 0} 

(A.44) x (E[l{m > s - ff > 0}1{^ > s - ff > OjH^it) 

xP^(i)|ff,ff]) 

/(P( Vl >a-f( T >0 i r ti >a-ff> 0|ff , ff )). 

However, since ^ and r/j are independent of each other and ff and ff, we 
have that 

E[l{ Vi > s - ff > 0}l{»fc > s - ff > 0}^(t)^'(t)|ff ,ff ] 



(A.45) = P[l{7fc> S -ff >0}iP^(i)|f, 



x > s - ff > 0}^'(t)|ff 1 



and 
(A.46) 



P( V i>s-f t N >0 )Vj >a-f^ >0|ff,ff) 

= Pfa > s - ff > 0|ff )P(^ > 8 - ff > 0|ff ^ 



u 3 — I 'J 

Applying Lemma 3.6 of [14] and using analogues of (A. 34), we have that 

i {77i > s -ff>o}-^ >s -^^ ^W^ 



p(TH>s-f? >o|ff; 

l{^> S -ff >0}E[P^(t)|Hf] 



and 



i{nj>8-ff >o} 



n P[lfa- > . - ff >0}P^(*)|ff] 



P(r ]j >s-f? >0|ff ) 

= l{ %>S -ff >0}P[P^(i)|ttf], 

so that dividing (A.45) by (A.46), using (A.44), the fact that ff = ff on 
{s — ff > 0, r]j > s — ff } = {s — ff > 0, rjj > s — ff } and the martingale 
property of H N ' 1 and H N ^ we get 

l{rn > s - ff > 0}l{ Vj > s - ff > OlPfP^^P^'^lftf ] 
= l{^> S -ff >0}P[^(t)|Wf] 

(A.47) 

xl{^> S -ff >0}E[H N *(t)\H?] 
= l{ Vi > s - ff > 0}£T JV ' i (a)l{?7 j > s - ff > 0}P^(s). 
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Substituting (A.41)-(A.43) and (A.47) into (A.40), we obtain (A. 36), which 
completes the proof of the lemma. □ 

Now note that by (4.3) and (A. 19), we have 
(A.48) Mf(i) = G N (t) + H N (t), 

where 

(A.49) ° N = W 

and 

ttN 

(A.50) RN = ^N- 

It therefore follows by (A.48) that in order to show as N — > oo, 

it will be sufficient to show that G N =>- and H as N — > oo. First, 
however, we must provide the following result. 
Let 

(A.51) i^) = ^, 

be the fluid scaled number of customers to enter service by time t. We then 
have the following. 

Lemma A. 2. For each T > 0, there exists a k >0 such that P(A N (T)> 
k) — > as iV~ — > oo. 

Proof. In order to show that the result is true, we stochastically bound 
{A N (T)} by another sequence of random variables for which the result holds. 
This will then imply that the result holds for {A N (T)} as well. 

Let min(Q Ar (T), N) be the total number of customers in service at time 
T. We then have that 

(A.52) mm(Q N (T),N) =mm(Q$,N) + A N (T) -D N (T), 

where D N (T) is the number of departures from the system by time T. 
Equation (A.52) then implies that 

A N (T) = min(Q 7V (T),N) + D N (T) -mm(Q$,N) 
(A.53) <mm(Q N (T),N) + D N (T) 

<N + D N (T). 

We next bound D N (T). Let S^(t) be the number of departures from 
server i in its first t units of processing time for t > and let Bf{t) be the 
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amount of time that server i is busy in the first t time units. We then have 
that 

N N 

D N (T)=Y / sf(B^(T)) <j2sf(n 

i=l i=l 

since Bf(T) < T. 

Now note that for each i, S^(T) is either the number of renewals by time 
T of a pure renewal process with interarrival distribution F or a delayed 
renewal process with delay distribution Fq and interarrival distribution F. 
Furthermore, for j, we have that S^(T) and S^(T) are independent of 
one another. Letting {Pi,i > 1} be an i.i.d. sequence of pure renewal pro- 
cesses with interarrival distribution F and {Qi,i > 1} an i.i.d. sequence of 
delayed renewal processes with delay distribution Fq and interarrival distri- 
bution F, it therefore follows that 

N N N 

N- 1 J2 Sf(T) < st N- 1 J2 Pi(T) + N" 1 J2 Qi(X) 

i=l i=l i=l 

=> M(T) + M D (T) as N -» oo, 

where M is the renewal function associated with Pi and is the renewal 
function associated with Q\. This completes the proof. □ 



We now show that => as N -> 
as N — > oo. Let 

(A.54) U N = 

We then have the following. 



oo. We begin by showing that G N =>• 
N ' 



Lemma A. 3. G N => as N oo. 



Proof. The proof of is nearly identical to the proof of Lemma 3.4 of 
[14] but for completeness we will include it here as well. 
We first show that for each 5 > and T > 0, 



(A.55) 



lim lim sup P I sup 

eiO N \0<t<T 



0. 



■ V N (t-x,x-) 
l-F(x-) 

xl{F(x-)>l-e}dF(x] 



>S 



where V N {t, x) = N^V" (t, x). 
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By (A. 14) and recalling the definition of U N from (A. 54), we have that 
for any k > 0, 

'* V N (t-x,x-) 



P 



sup 

Vo<t<T 



o l-F(x-) 
<P(A N (T) > kT) 

l{F(x-) > 



l{F(x-) >l-e}dF(x] 



>5 



sup \U N (t,F(x-))\dF(x)>5 . 
l-F(x-) Q<t<kT J 

For k sufficiently large, we have by Lemma A. 2 that 

P(A N (T) > kT) — > asiV^oo. 

Thus, by applying Chebyshev's inequality and Fubini's theorem, we now 
must prove that 



lim lim sup 

eiO N 



1{Fi f IV \ SUP \U N (t,F(x-))\dF(x)=0. 

1 — t[X— ) 0<t<kT 



However, the proof of this proceeds identically to as in Lemma 3.4 of [14], 
which completes the proof. □ 

We next show that H N converges to as N goes to oo. Again, the mod- 
ifications to the proof of Lemma 3.7 of [14] are slight but we include a full 
proof for completeness. 



Lemma A. 4. H 



N 



as N — > oo . 



Proof. Let 

A N {t) 

H N (t) = N~ 1 ]T (l{0< Vl <t-f t N } 



i=l 



%A(t-ff)+ dF ( u ) 



1 - F(u- 



t>0, 



and note that by (A. 17), (A.20) and (A.50) we have that 

A N (t) 

H N (t) = N- 1 ]T (l{ Vl = 0}-F(0)) + H N (t). 
i=i 

We first show that the term involving the summation converges to 0. Let 
T > and 5 > 0. We have 



P sup 

\0<t<T 



A" (t) 



N" 1 £ (lfa = 0}-F(0)) 

( 



i=i 

1 aN, 



<P(N- l A lv (T)>k) + P[ sup 

\0<i<l 



[Nkt\ 

N- 1 £ (lfa = 0}-F(0)) 

i=i 



>5 . 
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However, for sufficiently large k, we have by Lemma A. 2 that P(N~ 1 A N (T) > 
k) — > as N — > oo. Furthermore, by the functional strong law of large num- 
bers and the i.i.d. assumption of {rji,i > 1}, it follows that 

/ l Nkt \ \ 

N- 1 (HVi = 0} -F(0)) >S\ ^0 asN^oo. 

i=l ) 

It thus remains to show the convergence of H N to 0. 
Fix T > 0. For each e > 0, we have 

P( sup H N (t) >e) <P(N~ 1 A N (T) > k) + p( sup \H% k (t)\>e), 
where 

ttN 

n a 



P sup 

\0<t<l 



H 



N _ 11 Nk 

Nk 



N 

By definition (A. 15) and Lemma A. 2, for k sufficiently large, 
P(N~ 1 A N (T) > k) -> asiV->oo. 

Next, recall by Lemma A.l that is an H^-square-integrable martingale 
with predictable quadratic variation process 

(A.56) 

Thus, by the Lenglart-Rebolledo inequality [15], it follows that for any 7 > 0, 
P( sup \SUt)\>s)<^+P((H§ k )(T)> 7 ). 



dF(u) 



F(tx-) 



However, by (A.56), 

A N (T) 

(A.57) (^,)(r)<iv- 2 £ / T 

i=i Jo 1 

Furthermore, since £/[/^(l — F(u— )) _1 = 1, it follows by the func- 

tional strong law of large numbers that 

lN ' ] "K dF(u) 

- as iV -> 00. 



^ s /» 



i_f(«-) 

By (A.57), the Random Time Change theorem [1] and Lemma A. 2, this then 
implies that for any 7 > 0, 

P((5# fc )(T)>7)-0 asiV^oo, 
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which completes the proof. □ 

We are now in a position to give a proof of Proposition 4.2. 

PROOF of Proposition 4.2. The proof follows by the decomposition 
(A. 48) and Lemmas A. 3 and A. 4 above. □ 

We now proceed to proving Proposition 5.1. We first begin with the fol- 
lowing result. Recall the definition of A N (t) as the number of customers in 
the Nth. system who entered service after time 0— but before or at time t. 
Also, recall the definition of from (A. 51) as the fluid scaled version of 
A N . We then have the following result. 

Lemma A. 5. Under the assumptions of Section 5, A N =>• e as N —> oo. 

Proof. First, note the relationship 

A N (t) = A N (t) - (Q N (t) - N) + + (Q N (0) - N) + , t > 0, 

which, dividing by N, may be equivalently expressed as 

A N (t) = A N {t) - {Q N {t) - 1) + + (Q» - 1)+, t > 0. 

By (5.1), (5.2) and the Halfin-Whitt assumption (5.3), it follows that A N => 
e as N —> oo. Thus, by Corollary 5.1, the assumption that Qq =^ 1 as N — > oo 
and the Continuous Mapping theorem [20] , it follows that 

A N = A N - (Q N - 1)+ + (Q^ - 1)+ e as N — oo, 

which completes the proof. □ 



Now, define the processes 



N . 



and 



G 



H N 



G 



N 



'N 



<N 

and note that by (5.9) and (A. 19) it follows that 

(A.58) M? = G N + H N . 

Our next result will be to show that the sequence {M^} is tight. In order 
to show this, it will be sufficient to show that both {G N } and {H N } are 
tight. The proofs of these results are similar to proofs of Lemmas 3.4 and 
3.7 of [14], and hence have not been included. We begin with a proof of the 
tightness of {G N }. 



52 



J. REED 



Lemma A. 6. The sequence {G N } is tight. 

Proof. By virtue of Lemma A. 5 and the fact that the identity process 
e(t) = t is a continuous process, the proof now follows identically to the proof 
of Lemma 3.4 in [14]. The modifications to this proof are essentially trivial 
and the interested reader is referred to Lemma 3.4 of [14] for further details. 
□ 

Next, we show that {H N } is tight. 
Lemma A. 7. The sequence {H N } is tight. 

Proof. Since by Lemma A.l, the process HU is an H^-square-integrable- 
martingale for each N and k, by Lemma A. 5 the proof now follows similarly 
to the proof of Lemma 3.7 of [14] and will not be included. Again, the 
interested reader is referred to [14] for further details. □ 

We may now state the following result. 

Proposition A.l. The sequence {M%} is tight. 

Proof. The result follows by the decomposition (A. 58) and Lemmas A. 6 
and A. 7 above. □ 

We are now ready to give a proof of Proposition 5.1. Before doing so, 
however, we must first recall Lemma 5.2 from [14]. The proof of this result 
is similar in our case and therefore will not be included for the sake of brevity. 

Let Pi(x, y) be bounded real-valued Borel functions such that E[(3i(x, rji) = 
0] and define the processes by R% = {R*(t),t > 0} and (R%) = {{R%)(t),t > 
0}, m = l,2,..., by 

A N (t)Am A N (t)Am 

(A.59) £ mf, Vl ) and «)(*)= £ 

i=l i=l 

where 

p i (x) = E{3f(x,r ll ). 

We also set the <T-fields = cr{f^r] u 1 < i < [t\ } V N and = a{ff A 

f AN{t)+V ri iAAN(ty i > !} VA/", and define the nitrations = ,t > 0} 

and F N = {F t N ,t>0}. 

We then have the following result. 
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Lemma A. 8. 1. The ff ,i = 1,2, . . . , are F -stopping times, and the 
following inclusions hold: D P^.^Qf C Tf , where Qf = a{B n {t^ > 

t},t>0,Bef t N }; ^ 

2. The process A N is T N -predictable; 

3. The processes R^,m= 1,2,..., are F N -square-integrable martingales 
with the processes (-R^) as predictable quadratic-variation processes. 

Proof. The proof is identical to the proof of Lemma 5.2 of [14]. □ 

We are now prepared to give a proof of Proposition 5.1. 

Proof od Proposition 5.1. Onrproof is similar to the proof of Lemma 
5.3 of [14] but we restate it here for the sake of completeness. Our first step 
is to show that the finite-dimensional distributions of {M<2 ,M 2 ) converge 

to those of (M 2 ,M 2 ). We denote finite-dimensional convergence by =$■'. 
Let 

TjN 

and note that by Lemma 3.1 of [14], U N => U in D([0, oo), D[0, 1]) as N -» oo, 
where U is the Kiefer process. Next, let 

(A.60) M^ k (t)=j2OU N ((A N (st 1 ),F(0)),(A N (s'i),F(t-sf))), 

where the increment 

□C/ JV ((ai,a 2 ),(6i,6 2 )) = U N (h,b 2 ) ~ U N (ai,h) 

-U N (b 1 ,a 2 ) + U N (a 1 ,a 2 ), 
and the points = s§ < < • • • < s| = t are chosen such that 
max \s!i — — ► as k —> oo. 

l<i<k 

We also define in analogy, 

M 2 , k {t) = f)(DEr((e(*f_ 1 ) l F(0)), (e(s>°),F(t - S *))) 
i=i 

+ (U(e(s*),F(0))-U(e(st 1 ),F(0)))), 

where 

UU{{a u a 2 ), (b u b 2 )) = U(h,b 2 ) - U{a u b 2 ) ~ U(h,a 2 ) + U{a u a 2 ). 
We now show that 
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(a) M^4M 2tk , 

(b) lim^oo limsup^^ P(\M£ k (t) - M*{t)\ > r)) = for r, > 0, t > 0, 

(c) ]im n ^ 00 PQM$ r (t) - Mg{t)\ >rj) = for 77 > 0,t > 0. 

Since M 2 k (t) =>• M 2 (z) as k — > oo by definition, this will prove the finite- 
dimensional convergence stated in the paragraph above. 

The proofs of (a) and (b) are identical to the proofs in Lemma 5.3 of 
[14] but we include them here for the sake of completeness. We proceed as 
follows. 

By the Lemma 3.1 of [14] and the continuity of the Keifer process U, it 
follows, setting 

k 

(A.61) M 2 » = £ DU N ((e(sf),F(0)), (e(s k ), F(t - ,*))), t > 0, 
j=i 

that 

M^j. =^ M 2jfc as N ->• oo. 

Next, by Lemma A. 5, Lemma 3.1 of [14] and the continuity of U and e, we 
obtain from (A. 60) and (A.61) that 

(A.62) lim p( sup \M% k (t) - M% k (t)\ > e) = 0, T > 0, e > 0. 

This then implies that M^ k => M 2:k as A — ► oo, which completes the proof 
of (a). 

We will next prove (b), making use of Lemma A. 8. In the conditions of 
the lemma, we take, fixing t and k for the moment, 

k 

Pi(x,y) = ^l{s£_ 1 < x < s k }(l{t - s k < x <t - x} 
P =i 

-(F(t-x)-F(t-s k ))). 

Then 

h{x)=E\p i (x,<q i f] 

= ^ l{^_! < x < S k }(F(t -x)- F(t - s k p )) 
P =l 

x (1 - F(t - x) - F(t - 
and (A.59) yields, by (A. 13), (A. 16) and (A.60), 
(A.63) N-^R^t) = M 2 N (t) - M»(t) on {A N (t) < m}. 
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By (A.63) and (A.59), 
N'\R N m ){t) 

A N (t) k 

< N ~ l E E HsJ-i < ^ ^ 4K F (t - 4~i) - F (t - 4)) 

i=l p=l 

= JV" 1 £(F(t - - F(t - s k +p))(A N (s k ) - A N (s k _ 1 )) 
p=i 

< sup (N- 1 A N (s k p )-N- l A N (s k p _ 1 )). 

l<p<k 

Then, by Lemma A. 8, applying the Lenglart-Rebolledo inequality and (A.63), 
for rj > 0,e > 0, 

P(\M?(t)-M» k (t)\>r l ) 

< P(A N (t) > mN) + P{N~ l ' 2 \R^{t)\ > rj) 
<P(N- 1 A N (t)>m) + ^ 

+ P( sup (N~ 1 A N ( S k )-N- l A N (s k ))>e). 
i<p<fe 1 

By Lemma A. 5, continuity of the identity function e(t) = t and the fact that 
maxi< p <fc(s fe +p — Sp_i) — ► as — > oo, 

lim limsupPfiV 1 !^) > m) = 0, 

lim limsupPf sup (N" 1 A N (s k ) - N- 1 A N {s k 1 )) > e) =0, 

ending the proof of (b). 

We next prove part (c). The proof proceeds in a similar manner to the 
proof of parts (a) and (b). Letting B N (t) = [Nt\, we first note that 

M^{t) = N~ 1 ' 2 f* f\{ s + x <t}dU N (B N (s),x). 
Jo Jo 

Furthermore, setting B N = {N- l B N (t),t> 0}, it is clear that 
(A.64) B N =>e as N -c oo. 

Next, letting 

B» k (t) = J2 n^d^isl,), 0), (B N (s k ),F(t - s k ))), 

i=l 
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it follows by (A. 64), Lemma 3.1 of [14] and the continuity of U and e, that 
by (A.60), 




T>0,e>0. 



A similar proof to that of part (b) above can also be used to show that 
(A.66) lim ]imsupP(|B^ fc (t) - M 2 {t)\ >r]) = for rj > 0,t > 0. 

fc^OO jV->00 

Part (b), (A. 62), (A. 65) and (A.66) above now imply part (c). 

Parts (a)-(c) imply the finite-dimensional convergence (M 2 ,M 2 ) =^ 
(M 2 ,M 2 ) as N — > oo. It therefore remains to show that the sequence {(M^ , 
M 2 )} 1S tight in order to complete the proof. However, by Proposition 
A.l, the sequence {M 2 } is tight and a similar if not identical proof also 
shows that {M 2 } is tight. Thus, the sequence {(Af.f, Mf)} is tight in 
(D 2 [0,oo),dj ), which completes the proof. □ 

The remainder of the appendix is now devoted to providing proofs of Lem- 
mas A. 9 and A. 10. We begin with Lemma A. 10. Recall first the definition 
of /:Rx D 3 [0,oo) mKxD 3 [0,oo) in (5.18) and (5.19) as 

(A. 67) f({x 1 ,x 2 ,x 3 ,x i )) = (fi(xx),f 2 (x 2 ),f 3 (x 3 ), /4OE4)), 

for (xi,x 2 ,x 3 ,X4,) fix £> 3 [0,oo), where /i(xi) = xi,f 2 (x 2 ) = x 2 J A (x A ) = 
X4 and 

(A.68) f 3 (x 3 )(-)= f G(--s)dx 3 (s), 

Jo 

where the above integral above may be interpreted as the result of integra- 
tion by parts. 

We then have the following result. 

Lemma A. 9. The function f defined by (A. 67) and (A.68) is measurable 
as a map from (R x D 3 [0, 00), B(R) x V 3 ) to (R x D 3 [0, 00), B(R) x V 3 ). 
Furthermore, it is continuous at continuous limits points (xi,x 2 ,x 3 ,X4) £ 
R x D 3 [0, 00) such that x 2: x 3 ,x^ G C[0,oo). 

Proof. We first show that the function / : (R x D 3 [0, 00), B(R) x V 3 ) i-> 
(R x D 3 [0,oo),B(R) x V 3 ) is measurable. It is clear that /i:(R,B(R)) i-> 
(R,B{R)),f 2 :{D[0,oo),V) \-> (L>[0,oo),£>) and / 4 : (D[0, 00), V) ^ (D[0, 00), Z>) 
are measurable since each of these functions are the identity functions. 
Therefore, if we may now show that f 3 : (D[0, 00), T>) \— ► (D[0, 00), T>) is mea- 
surable, then, by (A. 67), we will have shown the measurability of /. 
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In order to show that f 3 : (-D[0, oo), V) t— > (D[0, oo), V) is measurable, first 
note that, integrating by parts, we have 

(A.69) h(x 3 ) = a{x 3 ) -b(x 3 ) -c(x 3 ), 

where a(x 3 ) = G(0)x 3 ,b(x 3 ) = x(0)G and 

(A.70) c(x 3 )(-)= f x 3 (--s)dG(s). 

Jo 

The functions 0(0:3) is measurable since it is the identity function multiplied 
by a constant and 6(23) is measurable as well since by [1] we have that 
the projection map is 710(23) = 23(C)) is a measurable function too. Thus, 
since the sum of a finit number of measurable functions is measurable, it 
remains to show that c(x 3 ) is measurable from (D[0,oo),D) to (D[0, 00), P) 
in order to complete the proof of the measurability of /. However, this may 
be shown in a manner similar to the proof of the measurability of in the 
measurability portion of the proof of Proposition 3.1. We omit the details 
for the sake of brevity. This completes the proof of the measurability of /. 

We now show that /:(lx D 3 [0,oo), | • | x d\) i-> (R x D 3 [0, 00), | • | x^) 
is continuous at continuous limit points (x±, X2, 23, 24) eKx Z) 3 [0,oo) such 
that X2, 23, 24 G C[0, 00). First, it is clear that the functions f\ : (R, | • |) 1— ► (R, 
I • |), /2 : (D[0, 00), u) i — > {D[0, 00), u) and : (D[0, 00), u) ^ {D[0, 00), u) are 
continuous. This follows easily since each of these functions are the identity 
functions. We now show that the function f 3 : (D[0, 00), u) ^ (D[0,oo),u) 
is continuous. This then implies that /:(R x Z) 3 [0,oo),| • | x n 3 ) 1— ► (R x 
-D 3 [0,oo),| • I x it 3 ) is continuous. However, since converge in (D[0, 00), dj x ) 
to a continuous limit point x £ C[0,oo) is equivalent to convergence in 
(D[0, 00), u), this then implies that / : (R x D 3 [0, 00), | • | x n 3 ) ^ (R x D 3 [0, 00), 
I • I x dj) is continuous a continuous limit points (xi, X2, x 3 , 24) S R x C 3 [0, 00), 
which completes the proof. 

Suppose first that X3 — > x 3 in (.D[0, 00), u) as n — > 00. It then follows that 
for each T > 0, 

sup (t) — x(t)\ —> asn^oo. 

0<t<T 

However, recalling the representation of 73(23) in (A.70), this then implies 
that 

sup \Mx%)(t)-f 3 (x 3 )(t)\ 

0<t<T 

= sup \(a(x n 3 )(t)-b(x n 3 )(t)-c(x n 3 )(t)) 

0<t<T 

-(a{x 3 ){t)-b{x 3 ){t)-c(x 3 )(t))\ 
= sup \( a (x n 3 )(t)-a(x 3 )(t))-(b(x n 3 )(t)-b(x 3 )(t)) 

0<t<T 
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-(c(xj)(t)-c(x s )(t))| 



■ sup 

0<t<T 



■ sup 

0<t<T 



(G(OK(t) - G(0)x 3 (i)) - (x^(O)G(t) - x 3 (0)G(t)) 

- ^* a#(t - s) dG(s) - J* x 3 (t - s) dG( S )^j 

G(0)(x5(t)-x s (t))-G(t)(xJ(0)-i s (0)) 

- [ t (x%{t-s)-x 3 (t-8))dG(s) 
Jo 

< sup |G(0)(xJ(t)-x 3 (t))|+ sup |G(t)(x£(0)-x 3 (0))| 
o<t<r o<t<r 



+ sup / 

o<t<T Jo 



(x%(t-s)-x 3 (t-s))dG(s) 



< sup |G(0)(xf(t)-x 3 (t))| + sup |G(i)(x£(0)-x 3 (0))| 

0<t<T 0<t<T 
ft 



sup / \x 3 (t-s)-x 3 (t-s)\dG(s) 

0<t<TJO 



<G(0) sup \x$(t)-x 3 (t)\ + G(T)\a%(0)-x 3 (0)\ 



0<t<T 



+ G(T) sup \x n 3 (t) - x 3 (t)\ 



0<t<T 

= (G(0)+2G(T)) sup |x£(i)-x 3 (t)| 

0<t<T 

^ as n — > oo, 

and so the function / 3 is continuous as a map from (-D[0, oo), it) to (D[0, oo), 
u), which completes the proof. □ 

We now provide a proof of Lemma A. 10 which is instrumental in the proof 
of Proposition 5.3. Our setup is the same as in the proof of Lemma A2 of 
Puhalskii and Reiman [17]. In particular, we consider a sequence of queueing 
systems indexed by N, each operating under the FIFO service discipline and 
each with a single arrival process = {A N (t),t > 0} and a single departure 
process D N = {D N (t),t > 0}. We denote by Q N (t) the queue length of the 
iVth system at time t, by V (t) the virtual waiting time at time t, and by 
the waiting time of the zth customer to arrive to the system. Finally, 
we set Q N (t) = N- 1 / 2 Q N (t), A N (t) = N- 1 / 2 {A N {t) - \ N t) where {A^} is 
a sequence of constants and we assume that A N {$) = D (0) = 0. We then 
have the following result. 
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Lemma A. 10. If Q N => Q and A N =4> £ as iV — > oo ; eac/i on D[0,oo), 
and A^/iV A > 0, then the processes {iV 1 /2yA r ( t ) ; t > } and {TV 1 / 2 ^Vjvtj , 
t > 0} converge in distribution on (D[0, oo), dj x ) to the respective processes 
{Q(t) /X,t>0} and {Q(t/X)/X,t>0}. 

Proof. First, note that since Q N => Q and A N £ as N -> oo, it 
follows by Prohorov's theorem [1] that the sequences {Q N ,N > 1} and 
{A N , N>1} are both tight. Thus, we have that sequence {(Q N ,A N ),N > 1} 
is tight in (D 2 [0, oo), d/j ) and hence, by a second application of Prohorov's 
theorem [1], the sequence {(Q N , A N ), N > 1} is relatively compact. Thus, 
for any subsequence {Nk}, there exists a further subsequence {N' k } such 

that (Q N k,A N 'k) (Q,A) as k -> oo. Thus, by Lemma A2 of Puhalskii 

and Reiman [17], we have that {N^ 1/2 V N 'k{t),t > 0} and {N' k 1/2 V^,t > 

0} converge in distribution on (D[0, oo), dj x ) to the respective processes 

{Q(t)/X,t > 0} and {Q(t/X)/X,t > 0}. However, since it must be the case 

that Q = Q and the sequence {Nk} was arbitrary, this completes the proof. 
□ 
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